-- Logs begin at Wed 2022-09-14 14:42:51 UTC, end at Wed 2022-09-14 15:40:27 UTC. -- Sep 14 15:13:00.787899 dv-osbrick-853789-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 14 15:13:00.795147 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 15:13:00 2022] *** Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: nodename: dv-osbrick-853789-4-ceph Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: machine: x86_64 Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: clock source: unix Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: pcre jit disabled Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: detected number of CPU cores: 4 Sep 14 15:13:00.797129 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: current working directory: / Sep 14 15:13:00.797791 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: detected binary path: /usr/bin/uwsgi-core Sep 14 15:13:00.797791 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: your processes number limit is 47680 Sep 14 15:13:00.797791 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: your memory page size is 4096 bytes Sep 14 15:13:00.797791 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: detected max file descriptor number: 2048 Sep 14 15:13:00.797791 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: lock engine: pthread robust mutexes Sep 14 15:13:00.800648 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: thunder lock: enabled Sep 14 15:13:00.800648 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 14 15:13:00.800648 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 15:13:00.842272 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: Python main interpreter initialized at 0x55fcf3c999c0 Sep 14 15:13:00.842272 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: python threads support enabled Sep 14 15:13:00.842272 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: your server socket listen backlog is limited to 100 connections Sep 14 15:13:00.842272 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: your mercy for graceful operations on workers is 90 seconds Sep 14 15:13:00.842664 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 15:13:00.842664 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: *** Operational MODE: preforking *** Sep 14 15:13:00.842934 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: *** uWSGI is running in multiple interpreter mode *** Sep 14 15:13:00.842934 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: spawned uWSGI master process (pid: 88087) Sep 14 15:13:00.843140 dv-osbrick-853789-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 14 15:13:00.849339 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: spawned uWSGI worker 1 (pid: 88101, cores: 1) Sep 14 15:13:00.849339 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: spawned uWSGI worker 2 (pid: 88102, cores: 1) Sep 14 15:13:00.849339 dv-osbrick-853789-4-ceph devstack@keystone.service[88087]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 15:13:05.474254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 15:13:05.474254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: from cryptography.utils import int_from_bytes Sep 14 15:13:05.475050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 15:13:05.475050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: from cryptography.utils import int_from_bytes Sep 14 15:13:05.476964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 15:13:05.476964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: from cryptography.utils import int_from_bytes Sep 14 15:13:05.477462 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 15:13:05.477462 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: from cryptography.utils import int_from_bytes Sep 14 15:13:05.524955 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 15:13:05.525136 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 15:13:05.525224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 15:13:05.525346 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 15:13:05.525433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] command line args: [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 15:13:05.525511 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] command line args: [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 15:13:05.525618 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 15:13:05.525764 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 15:13:05.525851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ================================================================================ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 15:13:05.525934 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ================================================================================ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 15:13:05.526029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] admin_token = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526174 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] admin_token = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] config_dir = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526413 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] config_dir = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526506 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526600 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] config_source = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526760 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] config_source = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526836 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] debug = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.526937 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] debug = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527027 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527350 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527770 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527871 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.527972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528071 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528176 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528377 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] log_config_append = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528476 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] log_config_append = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528570 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528675 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] log_dir = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528871 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] log_dir = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.528964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] log_file = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] log_file = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529156 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529260 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529728 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529803 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.529919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530006 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530131 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530212 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530333 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530728 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.530928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531003 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531127 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531202 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531323 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531416 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531486 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531594 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531818 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.531925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.532088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.532200 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.533139 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.533341 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.533488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] publish_errors = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.533583 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] publish_errors = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.533651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.533711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.533806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.533891 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534131 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534229 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534340 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] standard_threads = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534867 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] standard_threads = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.534994 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535136 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535212 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535321 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] use_journal = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] use_json = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535731 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] use_journal = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535867 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] use_stderr = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.535867 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] use_syslog = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.536052 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] use_json = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.536052 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] use_stderr = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.536218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.536379 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] use_syslog = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.536466 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.536545 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 15:13:05.536605 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.536825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.536952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.537033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.537166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.537248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.537343 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.537495 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.537600 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.537740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.537918 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.538032 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.538129 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.538228 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.538323 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.538423 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.538526 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.538731 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.538889 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539163 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539305 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539412 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.539857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.540020 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.540098 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.540270 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.540358 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.540538 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.540627 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.540856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.540968 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541063 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541366 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541585 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541722 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541826 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.541966 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.542076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.542186 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.542283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.542410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.542534 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.542643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.542784 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.542888 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543120 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543249 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543352 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543716 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543826 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.543966 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544067 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544297 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544454 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544668 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544891 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.544968 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.545122 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.545198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.545378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.545460 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.545614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.545748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.545838 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.545914 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546160 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546317 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546394 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546502 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546600 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.546956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.547034 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.547182 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.547258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.547405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.547481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.547636 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.547720 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.547916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.548517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.548653 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.548736 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.548879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.548960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.549115 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.549192 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.549368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.549480 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.549618 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.549695 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.549838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.549915 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.550075 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.550187 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.550305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.550383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.550537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.550613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.550770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.550858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.551001 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.551086 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.551227 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.551315 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.551595 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.551677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.551829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.551916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.552061 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.552148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.552292 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.552378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.552525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.552601 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.552779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.552862 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553012 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553090 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553515 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553599 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.553980 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.554065 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.554213 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.554291 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.554459 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.554536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.554696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.554786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.554930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555398 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555483 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555720 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.555959 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.556107 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.556194 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.556339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.556541 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.556626 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.556790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.556874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.557028 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.557107 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.557268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.557378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.557530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.557608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.557767 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.557846 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558458 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558692 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.558925 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559009 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559153 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559244 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559381 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559460 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559609 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.559919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560152 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560535 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.560998 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.561075 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.561227 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.561363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.561493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.561571 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.561729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.561818 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.561962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.external = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.562050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.562190 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.562268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.562444 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.562531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.562699 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.562782 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.562929 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.password = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563157 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.external = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563235 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.token = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563389 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563644 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563888 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.563967 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.564116 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.564194 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.password = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.564360 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.564446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.token = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.564641 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.564735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.564810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.564888 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.565045 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.565136 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.565284 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.565392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.565557 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.565637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.565842 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.565937 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566033 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566111 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566496 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566583 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566818 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.566987 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.567065 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.567221 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.567308 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.567469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.567547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.567703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.567782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.567950 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.568041 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.568202 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.568280 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.568438 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.568517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.568688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.568773 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.568920 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569000 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569230 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569544 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569649 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569878 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.569957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.570126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.570214 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.570361 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.570440 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.570610 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.570689 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.570841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.570929 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.571069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.571147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.571311 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.571388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.571545 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.571624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.571771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.571855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572017 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572095 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572262 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572495 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572576 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572726 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572805 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.572961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573040 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573184 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573262 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573440 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573523 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573771 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573917 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.573995 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.574147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.574225 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.574375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.574455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.574602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.574681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.574842 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.574925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.575087 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.575244 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.575325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.575397 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.575534 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.575613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.575765 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.575844 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576087 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576333 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576795 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.576949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577030 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577175 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577256 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577432 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577514 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577672 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577909 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.577990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.578153 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.578270 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.578376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.578455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.578609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.578688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.578850 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.578928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.579082 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.579160 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.579360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.579593 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.579677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.579842 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.579920 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.580078 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.580164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.580312 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.580390 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.580535 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.580613 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.580769 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.580879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581000 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581235 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581343 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581723 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.581957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.582034 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.582199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.582286 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.582424 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.582502 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.582652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.582731 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.582897 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583066 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583280 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583352 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583577 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.583887 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584271 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584504 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584581 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.584966 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.585046 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.585205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.585285 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.585471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.585552 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.585703 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.585784 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.585927 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586158 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586387 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586468 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586619 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.586925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.587080 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.587159 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.587316 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.587395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.587553 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.587632 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.587785 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.587866 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588023 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588250 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588328 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588491 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588572 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588727 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.588960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589038 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589187 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589438 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589518 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589678 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589915 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.589997 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.590150 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.590228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.590381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.590458 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.590612 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.590692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.590850 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.590928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.591082 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.591161 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.591311 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.591391 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.591542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.591621 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.591780 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.591858 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592095 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592243 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592322 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592475 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592553 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592791 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.592949 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593261 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593519 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593917 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.593998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.594147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.594228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.594384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.594461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.594612 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.594690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.595367 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.595451 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.595597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] role.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.595676 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.595840 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] role.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.595919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.596067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.596153 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.596302 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.596379 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.596536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] role.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.596614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.596779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.596859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] role.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.597012 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.597089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.597251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.597388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.597519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.597599 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.597761 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.597840 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598090 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598472 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598714 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.598956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.599035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.599184 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.599262 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.599432 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.599590 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.599671 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.599822 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.599900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.600072 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.600151 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.600318 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.600544 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.600623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.600778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.600856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601009 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601095 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601531 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601609 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.601992 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602071 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602221 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602447 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602692 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602770 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.602999 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.603155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.603235 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.603386 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.603465 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.603614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.603691 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.603841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.603921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.604071 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] token.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.604150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.604304 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.604383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.604548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.604628 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.604776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.604854 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605010 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] token.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605579 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.605976 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606056 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606297 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606527 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606682 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.606996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.607152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.607231 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.607385 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.607464 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.607622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.607701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.607857 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.607944 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.608101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.608188 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.608357 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.608435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.608589 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.608676 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.608831 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.608910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.609065 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.609152 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.609303 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.609467 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.609550 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.609611 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.609777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.609870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.610016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.610095 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.610249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.610329 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611025 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611121 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611256 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611335 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611490 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611567 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611718 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611805 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.611959 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612187 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612425 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612511 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612649 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612727 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.612964 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.613115 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.613201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.613275 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 15:13:05.613368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.613598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.613836 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.614069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 15:13:05.614239 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 15:13:05.644772 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.644992 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.645214 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.645636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.645873 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.646100 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.654061 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.654824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.683171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.683399 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.687231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.687464 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.738227 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.738499 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.788280 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.788526 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.788977 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.789214 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.856195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.856424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.856650 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.856837 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.856924 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.857071 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.857154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.857293 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.857427 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.857543 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.857762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.857988 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.881109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.881227 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.881378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.881465 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.881610 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.881707 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.881835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.881916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.882055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.882136 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.882277 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.882393 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.882473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.882538 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.894271 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.894516 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.907018 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.907180 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.907954 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908046 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908277 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908479 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908611 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908826 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.908915 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.909042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.909257 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 15:13:05.925771 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.925976 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 15:13:05.926076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.926188 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 15:13:05.926318 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.926521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 15:13:05.926602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.926719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 15:13:05.926809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.926998 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.927080 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.927265 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.927345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.927527 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.927610 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.927789 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.936995 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.937278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.937379 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.937667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.937762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.937860 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.937930 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.938281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.944847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.945306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.947806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.948096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.948392 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.948491 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.948680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.948761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.948972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.949088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.949235 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.949369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.949532 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.949623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.949816 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.949897 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.950105 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.950192 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.950390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.950470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.950672 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.950760 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.950949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.951229 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.976094 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.977602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.977893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.982063 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.982469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.982759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.983568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.983851 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.984697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.990118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.990405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.990687 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.991169 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.991465 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:05.997081 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:05.997405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.002207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.002508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.002791 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.003001 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.003276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.003359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.003589 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.003745 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.004003 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.004084 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.004287 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.004368 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.004557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.004644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.004840 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.005120 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.021040 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.021344 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.023087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.023378 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.025187 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.027274 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.028421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.028716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.030440 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.030854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.033551 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.035691 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.036665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.038879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.039865 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.040165 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.040448 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.040739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.041029 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.041395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.042010 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.042314 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.042605 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.043012 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.043310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.043609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.057029 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.057340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.057610 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.057874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.059858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.060158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.060433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.060704 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.065208 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.066752 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.068059 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.068289 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.068565 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.069742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.071222 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.071305 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.071506 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.071588 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.071797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.072091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.072473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.074308 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.074599 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.074902 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.075199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.075487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.084460 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.084460 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.084752 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.085028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.085432 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.085716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.085995 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.087415 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.087708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.087995 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.088295 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.088582 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.088873 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.089156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.101511 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.104442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.104865 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.107409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.107950 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.108797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.110284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.110625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.110987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.111664 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.112724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.114580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.114929 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.115308 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.117456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.118912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.121774 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.122173 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.122256 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.122457 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.122737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.123655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.127693 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.128077 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.128481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.131650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.131943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.132226 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.137030 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.137345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.137639 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.140054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.140342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.140624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.141106 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.141267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.141491 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.142328 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.142598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.142893 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.143163 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.143447 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.143709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.143973 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.144233 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.146153 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 15:13:06.146446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.146735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.147016 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.147295 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.147575 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.147857 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.148141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.148431 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.148706 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.148993 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.149269 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.149562 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.149829 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 15:13:06.177155 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fcf3c999c0 pid: 88102 (default app) Sep 14 15:13:06.180419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6247e8-eb85-4159-8012-aa6a767d9598 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:06.180711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6247e8-eb85-4159-8012-aa6a767d9598 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:06.180982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6247e8-eb85-4159-8012-aa6a767d9598 None None] PATH_INFO: `/v3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:06.182945 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fcf3c999c0 pid: 88101 (default app) Sep 14 15:13:06.185078 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Wed Sep 14 15:13:06 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:13.418298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5c6d-0c84-48be-acd9-b11442596826 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.418848 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5c6d-0c84-48be-acd9-b11442596826 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.418848 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5c6d-0c84-48be-acd9-b11442596826 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.423143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:13:13.428628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:13.429205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:13.429205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:13.505387 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: INFO dbcounter [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] Registered counter for database keystone Sep 14 15:13:13.524912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG oslo_db.sqlalchemy.engines [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 15:13:13.531201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writer thread running {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 15:13:13.708618 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG passlib.handlers.bcrypt [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88102) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 15:13:13.709021 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG passlib.handlers.bcrypt [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88102) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 15:13:13.767663 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:13.769283 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:13.896189 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 14 15:13:14.381524 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee5c6d-0c84-48be-acd9-b11442596826 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.455672 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: INFO dbcounter [None req-8fee5c6d-0c84-48be-acd9-b11442596826 None None] Registered counter for database keystone Sep 14 15:13:14.477537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG oslo_db.sqlalchemy.engines [None req-8fee5c6d-0c84-48be-acd9-b11442596826 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 15:13:14.483847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writer thread running {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 15:13:14.602299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee5c6d-0c84-48be-acd9-b11442596826 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.606648 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938b8ff-0df4-44db-89f1-79fba2033fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.607271 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938b8ff-0df4-44db-89f1-79fba2033fab admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.607555 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938b8ff-0df4-44db-89f1-79fba2033fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.607833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938b8ff-0df4-44db-89f1-79fba2033fab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.616697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938b8ff-0df4-44db-89f1-79fba2033fab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.670093 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a938b8ff-0df4-44db-89f1-79fba2033fab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 15:13:14.670435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938b8ff-0df4-44db-89f1-79fba2033fab admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.679999 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1324 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:13:14.685987 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:14.702566 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ca18-ce87-45f8-b192-c1ea38b21ce2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:14.707699 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef433e-35a5-4ac1-90e3-46e84d613f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:14.708813 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef433e-35a5-4ac1-90e3-46e84d613f7a admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:14.709095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef433e-35a5-4ac1-90e3-46e84d613f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:14.709395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef433e-35a5-4ac1-90e3-46e84d613f7a admin admin] PATH_INFO: `/v3/projects/d960b8bb994249d4bc3ba704789927ea` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:14.713099 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef433e-35a5-4ac1-90e3-46e84d613f7a admin admin] RBAC: Authorizing `identity:get_project(project_id=d960b8bb994249d4bc3ba704789927ea)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:14.764287 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0ef433e-35a5-4ac1-90e3-46e84d613f7a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 15:13:14.764628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef433e-35a5-4ac1-90e3-46e84d613f7a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:14.769703 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 3/5] 10.222.0.66 () {56 vars in 1207 bytes} [Wed Sep 14 15:13:14 2022] GET /identity/v3/projects/d960b8bb994249d4bc3ba704789927ea => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:17.124482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be2e9-77d4-4e9c-b72c-c48eea214167 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:17.125043 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be2e9-77d4-4e9c-b72c-c48eea214167 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:17.125043 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be2e9-77d4-4e9c-b72c-c48eea214167 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:17.130039 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 3/6] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:17.135387 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeffdd-84a0-45f7-a20c-a5b6175852ea None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:17.135830 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeffdd-84a0-45f7-a20c-a5b6175852ea None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:17.135931 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeffdd-84a0-45f7-a20c-a5b6175852ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:17.155667 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8ffeffdd-84a0-45f7-a20c-a5b6175852ea None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:17.157205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8ffeffdd-84a0-45f7-a20c-a5b6175852ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:17.164935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 15:13:17.485791 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be2e9-77d4-4e9c-b72c-c48eea214167 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:17.498243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be2e9-77d4-4e9c-b72c-c48eea214167 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:17.503185 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e20f9-9be7-4562-bfe4-6870a94c3413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:17.503775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e20f9-9be7-4562-bfe4-6870a94c3413 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:17.504054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e20f9-9be7-4562-bfe4-6870a94c3413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:17.504324 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e20f9-9be7-4562-bfe4-6870a94c3413 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:17.511853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e20f9-9be7-4562-bfe4-6870a94c3413 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:17.513652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e20f9-9be7-4562-bfe4-6870a94c3413 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:17.522810 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1324 bytes} [Wed Sep 14 15:13:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 15:13:17.528175 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeffdd-84a0-45f7-a20c-a5b6175852ea None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:17.537292 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeffdd-84a0-45f7-a20c-a5b6175852ea None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:17.541697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40607ead-38da-4ef2-b573-b5e45d49536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:17.542323 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607ead-38da-4ef2-b573-b5e45d49536b admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:17.542608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607ead-38da-4ef2-b573-b5e45d49536b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:17.542885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607ead-38da-4ef2-b573-b5e45d49536b admin admin] PATH_INFO: `/v3/users/076e0863cb5c4974ba2d2e1b515b38f4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:17.544185 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40607ead-38da-4ef2-b573-b5e45d49536b admin admin] RBAC: Authorizing `identity:get_user(user_id=076e0863cb5c4974ba2d2e1b515b38f4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:17.546058 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40607ead-38da-4ef2-b573-b5e45d49536b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:17.547591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 5/9] 10.222.0.66 () {56 vars in 1198 bytes} [Wed Sep 14 15:13:17 2022] GET /identity/v3/users/076e0863cb5c4974ba2d2e1b515b38f4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:19.976461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375115-05da-497a-854e-9b44d860afb7 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:19.976970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375115-05da-497a-854e-9b44d860afb7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:19.977055 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375115-05da-497a-854e-9b44d860afb7 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:19.978375 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:19.983481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24fea-0b3d-4358-a00d-22fa12ea596b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:19.983943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24fea-0b3d-4358-a00d-22fa12ea596b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:19.984071 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24fea-0b3d-4358-a00d-22fa12ea596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.003167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3ac24fea-0b3d-4358-a00d-22fa12ea596b None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:20.004337 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3ac24fea-0b3d-4358-a00d-22fa12ea596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:20.031475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c012-cf52-4558-a9b7-8d3e0cf88717 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.031762 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c012-cf52-4558-a9b7-8d3e0cf88717 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.032044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c012-cf52-4558-a9b7-8d3e0cf88717 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.033404 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 6/11] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:13:20.038435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.038719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.038990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.081072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG passlib.handlers.bcrypt [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88101) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 15:13:20.081491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG passlib.handlers.bcrypt [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88101) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 15:13:20.087120 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:20.131087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:20.132660 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:20.230723 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:13:20.410297 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac24fea-0b3d-4358-a00d-22fa12ea596b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:20.435382 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:20.550171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:20.626329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac24fea-0b3d-4358-a00d-22fa12ea596b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:20.653214 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658be5a5-81aa-40de-80d7-dc6b392747c6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:20.655575 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:20.662917 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b89c5-c646-484f-9224-85e1b6a827e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:20.663561 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b89c5-c646-484f-9224-85e1b6a827e1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.663845 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b89c5-c646-484f-9224-85e1b6a827e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.664122 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b89c5-c646-484f-9224-85e1b6a827e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.675915 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b89c5-c646-484f-9224-85e1b6a827e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-183b89c5-c646-484f-9224-85e1b6a827e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:20.684651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:20.685625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:20.686469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 7/14] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:20.691866 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b89c5-c646-484f-9224-85e1b6a827e1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:20.695055 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30de63-ba90-40e0-ba0c-faa97e4c0c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:20.695926 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30de63-ba90-40e0-ba0c-faa97e4c0c42 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.696205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30de63-ba90-40e0-ba0c-faa97e4c0c42 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.696478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30de63-ba90-40e0-ba0c-faa97e4c0c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.765157 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30de63-ba90-40e0-ba0c-faa97e4c0c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:20.767059 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30de63-ba90-40e0-ba0c-faa97e4c0c42 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:20.776294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:20.796407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b89c5-c646-484f-9224-85e1b6a827e1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:20.829732 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:20.830786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.831068 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.831340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.832006 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:20.832307 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:20.833724 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:20.845160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 8/15] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:20.851526 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:20.868011 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 8/16] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:13:20.873456 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30de63-ba90-40e0-ba0c-faa97e4c0c42 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:20.876869 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:20.948523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804bb35-daf5-4197-b753-8ba904d6e980 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:20.972020 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30de63-ba90-40e0-ba0c-faa97e4c0c42 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:20.983597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1543-12b9-4923-ab48-82cf73d23391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:20.984234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1543-12b9-4923-ab48-82cf73d23391 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:20.984520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1543-12b9-4923-ab48-82cf73d23391 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:20.984795 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1543-12b9-4923-ab48-82cf73d23391 None admin] PATH_INFO: `/v3/users/076e0863cb5c4974ba2d2e1b515b38f4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:20.985957 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a1543-12b9-4923-ab48-82cf73d23391 None admin] RBAC: Authorizing `identity:get_user(user_id=076e0863cb5c4974ba2d2e1b515b38f4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:20.987444 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a1543-12b9-4923-ab48-82cf73d23391 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:20.989014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 9/17] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/users/076e0863cb5c4974ba2d2e1b515b38f4 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:20.994420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1543-12b9-4923-ab48-82cf73d23391 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:21.006919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:21.007767 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:21.008042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:21.008308 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:21.008823 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:21.030336 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:21.031818 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:21.051387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:21.052321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:21.053137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:21.053137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:21.053137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:21.053137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 9/18] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:21.058221 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:21.100434 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1543-12b9-4923-ab48-82cf73d23391 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:21.139876 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076846b6-4428-4e96-8e1b-443df479b13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:21.140528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076846b6-4428-4e96-8e1b-443df479b13f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:21.140814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076846b6-4428-4e96-8e1b-443df479b13f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:21.141088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076846b6-4428-4e96-8e1b-443df479b13f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:21.142334 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076846b6-4428-4e96-8e1b-443df479b13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:21.144413 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076846b6-4428-4e96-8e1b-443df479b13f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:21.146065 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 10/19] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:21.152272 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076846b6-4428-4e96-8e1b-443df479b13f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:21.225333 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:21.236321 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:21.256743 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076846b6-4428-4e96-8e1b-443df479b13f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:21.271121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3ac8e-e59c-4021-bc06-cdf144c1f737 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:21.290415 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658e79f-2f80-453a-a46d-3f26c33d45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:21.291028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658e79f-2f80-453a-a46d-3f26c33d45af None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:21.291313 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658e79f-2f80-453a-a46d-3f26c33d45af None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:21.291591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658e79f-2f80-453a-a46d-3f26c33d45af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:21.292307 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658e79f-2f80-453a-a46d-3f26c33d45af None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.domain.id=default, user.id=076e0863cb5c4974ba2d2e1b515b38f4) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:21.292620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658e79f-2f80-453a-a46d-3f26c33d45af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:21.294085 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658e79f-2f80-453a-a46d-3f26c33d45af None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:21.302532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 11/20] 10.222.0.66 () {56 vars in 1322 bytes} [Wed Sep 14 15:13:21 2022] GET /identity/v3/role_assignments?user.id=076e0863cb5c4974ba2d2e1b515b38f4&scope.domain.id=default&role.id=6211512533b744e8b1ee9031113654ac => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:21.309685 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d82e-9722-4d0c-a393-0ed34501c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:21.310514 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d82e-9722-4d0c-a393-0ed34501c74f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:21.310725 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d82e-9722-4d0c-a393-0ed34501c74f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:21.311007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d82e-9722-4d0c-a393-0ed34501c74f None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:21.311681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d82e-9722-4d0c-a393-0ed34501c74f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:21.311985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d82e-9722-4d0c-a393-0ed34501c74f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:21.313653 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d82e-9722-4d0c-a393-0ed34501c74f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:21.334654 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 10/21] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:24.011049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225baa9-b20a-4369-9615-b4af2b03f558 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.012126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225baa9-b20a-4369-9615-b4af2b03f558 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.012629 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225baa9-b20a-4369-9615-b4af2b03f558 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.014214 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 12/22] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:24.019918 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d9e7-f0bb-4a66-88e8-207941696760 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.020356 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d9e7-f0bb-4a66-88e8-207941696760 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.020535 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d9e7-f0bb-4a66-88e8-207941696760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.046123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2cf7d9e7-f0bb-4a66-88e8-207941696760 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:24.047548 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2cf7d9e7-f0bb-4a66-88e8-207941696760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:24.134980 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 11/23] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:24.242946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54358a3d-d23c-449c-9931-58f29b6ee737 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.243602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54358a3d-d23c-449c-9931-58f29b6ee737 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.244128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54358a3d-d23c-449c-9931-58f29b6ee737 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.245754 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:24.251864 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e0bc-25f6-41ff-90e9-4f0ae4cc4a80 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.252678 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e0bc-25f6-41ff-90e9-4f0ae4cc4a80 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.252955 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e0bc-25f6-41ff-90e9-4f0ae4cc4a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.278997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d3e8e0bc-25f6-41ff-90e9-4f0ae4cc4a80 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:24.280106 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d3e8e0bc-25f6-41ff-90e9-4f0ae4cc4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:24.352321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:24.381916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 12/25] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:13:24.638863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54358a3d-d23c-449c-9931-58f29b6ee737 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:24.674811 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7edad-6299-486e-9825-3c99633bcc7b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.675146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7edad-6299-486e-9825-3c99633bcc7b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.675375 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7edad-6299-486e-9825-3c99633bcc7b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.677042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 13/26] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:24.686112 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd3635-39ac-4284-b160-10c8a0521a6a None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.686441 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd3635-39ac-4284-b160-10c8a0521a6a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.686720 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd3635-39ac-4284-b160-10c8a0521a6a None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.687965 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 14/27] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:13:24.695017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ac13-d94f-48b3-b8a8-5e5f117f347c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.695304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ac13-d94f-48b3-b8a8-5e5f117f347c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.695587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ac13-d94f-48b3-b8a8-5e5f117f347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.732511 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9fa0ac13-d94f-48b3-b8a8-5e5f117f347c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:24.733788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9fa0ac13-d94f-48b3-b8a8-5e5f117f347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:24.791373 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54358a3d-d23c-449c-9931-58f29b6ee737 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:24.830920 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ee27-5bcf-435e-b24b-4b0107351592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:24.831557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ee27-5bcf-435e-b24b-4b0107351592 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.831839 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ee27-5bcf-435e-b24b-4b0107351592 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.832110 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ee27-5bcf-435e-b24b-4b0107351592 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.832700 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 15/28] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:13:24.834138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba5452-d8d4-4e20-9fe7-47565f5f3ce7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:24.834737 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba5452-d8d4-4e20-9fe7-47565f5f3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:24.835013 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba5452-d8d4-4e20-9fe7-47565f5f3ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:24.844027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2ee27-5bcf-435e-b24b-4b0107351592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-7ca2ee27-5bcf-435e-b24b-4b0107351592 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:24.849630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:24.850547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:24.851342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 14/29] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:24.852325 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ee27-5bcf-435e-b24b-4b0107351592 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:24.858225 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:24.864714 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-feba5452-d8d4-4e20-9fe7-47565f5f3ce7 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:24.866670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-feba5452-d8d4-4e20-9fe7-47565f5f3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:24.989852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 16/30] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:24.990508 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba5452-d8d4-4e20-9fe7-47565f5f3ce7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:25.012322 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ee27-5bcf-435e-b24b-4b0107351592 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:25.052299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:25.072911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:25.073569 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:25.073848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:25.074119 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:25.091389 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:25.092864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:13:25.118137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:25.119145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:13:25.119946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:13:25.119946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:13:25.119946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:25.126858 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 15/31] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:25.132567 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:25.172625 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba5452-d8d4-4e20-9fe7-47565f5f3ce7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:25.233291 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:25.235005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:25.235691 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:25.236009 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:25.236280 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:25.237008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:25.237307 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:25.238718 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:25.265366 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 17/32] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:25.272618 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:25.331108 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab45887-4d67-4fab-822f-856f505e71b4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:25.399851 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:25.400463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:25.400741 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:25.401009 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:25.404379 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:25.404690 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:25.406246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:25.427620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 16/33] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:25.428735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:25.458075 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:25.462239 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d5c06-497d-46e8-85d6-e69369923b11 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:25.500381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089c32a-4d83-427d-a1e1-dc4c2f5cf2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:25.501136 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c32a-4d83-427d-a1e1-dc4c2f5cf2a6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:25.501518 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c32a-4d83-427d-a1e1-dc4c2f5cf2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:25.501797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c32a-4d83-427d-a1e1-dc4c2f5cf2a6 None admin] PATH_INFO: `/v3/users/076e0863cb5c4974ba2d2e1b515b38f4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:25.503990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089c32a-4d83-427d-a1e1-dc4c2f5cf2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=076e0863cb5c4974ba2d2e1b515b38f4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:25.505587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089c32a-4d83-427d-a1e1-dc4c2f5cf2a6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:25.507291 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 18/34] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:25 2022] GET /identity/v3/users/076e0863cb5c4974ba2d2e1b515b38f4 => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:25.512253 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089c32a-4d83-427d-a1e1-dc4c2f5cf2a6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:25.554605 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed11c5-a8ba-4500-8cc5-5f93b6b1a2b7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:25.573972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:25.596938 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b5d0-6726-49fd-9a97-8d2860faa56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:25.597987 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b5d0-6726-49fd-9a97-8d2860faa56b None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:25.598492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b5d0-6726-49fd-9a97-8d2860faa56b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:25.599013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b5d0-6726-49fd-9a97-8d2860faa56b None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:25.600030 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86b5d0-6726-49fd-9a97-8d2860faa56b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:25.601909 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86b5d0-6726-49fd-9a97-8d2860faa56b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:25.626349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089c32a-4d83-427d-a1e1-dc4c2f5cf2a6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:25.663578 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdb3bf-61c6-44be-886b-c5b1a202e1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:25.664196 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdb3bf-61c6-44be-886b-c5b1a202e1f1 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:25.664482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdb3bf-61c6-44be-886b-c5b1a202e1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:25.664762 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdb3bf-61c6-44be-886b-c5b1a202e1f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:25.665466 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdb3bf-61c6-44be-886b-c5b1a202e1f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:25.666846 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdb3bf-61c6-44be-886b-c5b1a202e1f1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:25.743340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 17/35] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Sep 14 15:13:25 2022] POST /identity/v3/roles => generated 219 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:25.744685 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b5d0-6726-49fd-9a97-8d2860faa56b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:25.810418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 19/36] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Sep 14 15:13:25 2022] POST /identity/v3/roles => generated 225 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:25.811161 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdb3bf-61c6-44be-886b-c5b1a202e1f1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:25.864818 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b5d0-6726-49fd-9a97-8d2860faa56b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:25.869834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:25.917056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7576-7f34-4b1e-80dc-34255a66896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:25.918117 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7576-7f34-4b1e-80dc-34255a66896a None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:25.918868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7576-7f34-4b1e-80dc-34255a66896a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:25.919340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7576-7f34-4b1e-80dc-34255a66896a None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:25.921442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b7576-7f34-4b1e-80dc-34255a66896a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:25.923519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b7576-7f34-4b1e-80dc-34255a66896a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:25.973429 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:13:25 2022] POST /identity/v3/projects => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:26.005677 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdb3bf-61c6-44be-886b-c5b1a202e1f1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:26.050807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f851-6254-4faf-94ed-5e3dd0892f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:26.051497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f851-6254-4faf-94ed-5e3dd0892f54 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.051786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f851-6254-4faf-94ed-5e3dd0892f54 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.052066 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f851-6254-4faf-94ed-5e3dd0892f54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.053595 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9f851-6254-4faf-94ed-5e3dd0892f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:26.055336 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9f851-6254-4faf-94ed-5e3dd0892f54 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:26.057123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:26.063474 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7576-7f34-4b1e-80dc-34255a66896a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:26.099569 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:26.207921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af574-4279-4cfb-b7d7-c146c8d504f8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.208248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af574-4279-4cfb-b7d7-c146c8d504f8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.208493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af574-4279-4cfb-b7d7-c146c8d504f8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.209920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 21/39] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:13:26.216322 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e5c5-735c-4588-8c36-852e048d6848 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.216581 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e5c5-735c-4588-8c36-852e048d6848 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.216964 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e5c5-735c-4588-8c36-852e048d6848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.221523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7576-7f34-4b1e-80dc-34255a66896a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:26.239664 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-cae6e5c5-735c-4588-8c36-852e048d6848 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:26.241442 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cae6e5c5-735c-4588-8c36-852e048d6848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:26.285908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fc9e7-bf36-4484-8917-2b2a542c42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:26.286613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc9e7-bf36-4484-8917-2b2a542c42c9 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.286893 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc9e7-bf36-4484-8917-2b2a542c42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.287176 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc9e7-bf36-4484-8917-2b2a542c42c9 None admin] PATH_INFO: `/v3/domains/default/users/076e0863cb5c4974ba2d2e1b515b38f4/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.292397 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fc9e7-bf36-4484-8917-2b2a542c42c9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=076e0863cb5c4974ba2d2e1b515b38f4, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:26.293951 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fc9e7-bf36-4484-8917-2b2a542c42c9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:26.319568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 19/40] 10.222.0.66 () {58 vars in 1361 bytes} [Wed Sep 14 15:13:26 2022] PUT /identity/v3/domains/default/users/076e0863cb5c4974ba2d2e1b515b38f4/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:13:26.369422 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 22/41] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:13:26.488388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a6b5f-f575-4dbc-8860-07bb5b4aaf14 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.488776 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a6b5f-f575-4dbc-8860-07bb5b4aaf14 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.489158 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a6b5f-f575-4dbc-8860-07bb5b4aaf14 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.491314 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 20/42] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:26.497059 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c29e9-3237-4c23-878a-ff5b90f36665 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.497407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c29e9-3237-4c23-878a-ff5b90f36665 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.497667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c29e9-3237-4c23-878a-ff5b90f36665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.517245 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-790c29e9-3237-4c23-878a-ff5b90f36665 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:26.518558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-790c29e9-3237-4c23-878a-ff5b90f36665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:26.539171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:26.594109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 23/43] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:26.704381 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a6b5f-f575-4dbc-8860-07bb5b4aaf14 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:26.805250 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:26.821881 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a6b5f-f575-4dbc-8860-07bb5b4aaf14 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:26.857823 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb9d36-49fb-4e19-92b2-037a99861fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:26.858359 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb9d36-49fb-4e19-92b2-037a99861fa0 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:26.858640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb9d36-49fb-4e19-92b2-037a99861fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:26.858912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb9d36-49fb-4e19-92b2-037a99861fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:26.859715 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb9d36-49fb-4e19-92b2-037a99861fa0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:26.860967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb9d36-49fb-4e19-92b2-037a99861fa0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:26.877732 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 21/44] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Sep 14 15:13:26 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:26.923231 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c29e9-3237-4c23-878a-ff5b90f36665 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:27.033732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c29e9-3237-4c23-878a-ff5b90f36665 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:27.071308 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560d48f-605d-4614-8897-4a6b89c2dcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:27.071979 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d48f-605d-4614-8897-4a6b89c2dcc2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:27.072287 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d48f-605d-4614-8897-4a6b89c2dcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:27.072568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d48f-605d-4614-8897-4a6b89c2dcc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:27.073746 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560d48f-605d-4614-8897-4a6b89c2dcc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:27.075222 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560d48f-605d-4614-8897-4a6b89c2dcc2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:27.076964 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 24/45] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:27.082952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb9d36-49fb-4e19-92b2-037a99861fa0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:27.214012 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb9d36-49fb-4e19-92b2-037a99861fa0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:27.246140 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc0e23-87a8-489b-acaa-c50cac304749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:27.246746 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc0e23-87a8-489b-acaa-c50cac304749 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:27.247026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc0e23-87a8-489b-acaa-c50cac304749 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:27.247296 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc0e23-87a8-489b-acaa-c50cac304749 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:27.247941 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc0e23-87a8-489b-acaa-c50cac304749 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:27.249421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc0e23-87a8-489b-acaa-c50cac304749 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:27.271519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:27.285340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 22/46] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:13:27 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:28.779116 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259366-38ec-45ed-87f8-2f465b4c7538 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:28.779656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259366-38ec-45ed-87f8-2f465b4c7538 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:28.779656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259366-38ec-45ed-87f8-2f465b4c7538 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:28.781019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 25/47] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:28.786410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf61a-7f75-4d49-b195-d13ea0988640 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:28.786817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf61a-7f75-4d49-b195-d13ea0988640 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:28.786981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf61a-7f75-4d49-b195-d13ea0988640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:28.804998 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e59bf61a-7f75-4d49-b195-d13ea0988640 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:28.806543 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e59bf61a-7f75-4d49-b195-d13ea0988640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:28.871558 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 23/48] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:29.189732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259366-38ec-45ed-87f8-2f465b4c7538 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:29.214472 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:29.298607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259366-38ec-45ed-87f8-2f465b4c7538 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:29.335923 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db18b01-a338-4294-9b43-fe49a34b21f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:29.336564 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db18b01-a338-4294-9b43-fe49a34b21f4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:29.336849 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db18b01-a338-4294-9b43-fe49a34b21f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:29.337127 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db18b01-a338-4294-9b43-fe49a34b21f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:29.348219 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db18b01-a338-4294-9b43-fe49a34b21f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1db18b01-a338-4294-9b43-fe49a34b21f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:29.355359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:29.356383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:29.357372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 26/49] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:29.362378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bf61a-7f75-4d49-b195-d13ea0988640 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:29.461497 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bf61a-7f75-4d49-b195-d13ea0988640 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:29.489853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:29.496350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:29.496967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:29.497254 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:29.497562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:29.498235 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:29.498544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:29.499939 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:29.520642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 24/50] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:29.526346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db18b01-a338-4294-9b43-fe49a34b21f4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:29.612132 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:29.630429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db18b01-a338-4294-9b43-fe49a34b21f4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:29.662681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763817c-deb6-4f22-9356-e8337fc8a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:29.663316 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763817c-deb6-4f22-9356-e8337fc8a000 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:29.663600 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763817c-deb6-4f22-9356-e8337fc8a000 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:29.663876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763817c-deb6-4f22-9356-e8337fc8a000 None admin] PATH_INFO: `/v3/users/076e0863cb5c4974ba2d2e1b515b38f4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:29.665002 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763817c-deb6-4f22-9356-e8337fc8a000 None admin] RBAC: Authorizing `identity:get_user(user_id=076e0863cb5c4974ba2d2e1b515b38f4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:29.666518 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763817c-deb6-4f22-9356-e8337fc8a000 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:29.668088 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 27/51] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:29 2022] GET /identity/v3/users/076e0863cb5c4974ba2d2e1b515b38f4 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:29.673586 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:29.692773 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623bea2-1b42-4af9-99d2-1d8c02730b38 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:29.693351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623bea2-1b42-4af9-99d2-1d8c02730b38 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:29.693617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623bea2-1b42-4af9-99d2-1d8c02730b38 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:29.694948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 28/52] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:13:29.699896 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e5d8-1e4d-415b-bf52-e65deebee8ad None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:29.700185 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e5d8-1e4d-415b-bf52-e65deebee8ad None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:29.700467 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e5d8-1e4d-415b-bf52-e65deebee8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:29.718189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-fb29e5d8-1e4d-415b-bf52-e65deebee8ad None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:29.719364 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fb29e5d8-1e4d-415b-bf52-e65deebee8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:29.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606167d-98aa-4356-80f6-391417fce12a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:29.785633 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 29/53] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:13:29.807493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489fb0c-b30f-475e-b7c4-6e50ae645cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:29.808123 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489fb0c-b30f-475e-b7c4-6e50ae645cb2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:29.808403 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489fb0c-b30f-475e-b7c4-6e50ae645cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:29.808673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489fb0c-b30f-475e-b7c4-6e50ae645cb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:29.809789 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489fb0c-b30f-475e-b7c4-6e50ae645cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:29.811234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489fb0c-b30f-475e-b7c4-6e50ae645cb2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:29.812993 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 25/54] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:29.819510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e5d8-1e4d-415b-bf52-e65deebee8ad None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:29.898815 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:29.917793 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e5d8-1e4d-415b-bf52-e65deebee8ad None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:29.952545 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:29.953151 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:29.953467 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:29.953745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:29.954463 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.domain.id=default, user.id=076e0863cb5c4974ba2d2e1b515b38f4) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:29.954770 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:29.956239 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:29.964689 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 30/55] 10.222.0.66 () {56 vars in 1322 bytes} [Wed Sep 14 15:13:29 2022] GET /identity/v3/role_assignments?user.id=076e0863cb5c4974ba2d2e1b515b38f4&scope.domain.id=default&role.id=6211512533b744e8b1ee9031113654ac => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:30.114703 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489fb0c-b30f-475e-b7c4-6e50ae645cb2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:30.176414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:30.219004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489fb0c-b30f-475e-b7c4-6e50ae645cb2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:30.253603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ef5b8-70f5-43fa-96f7-f8a276cd41fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:30.254234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ef5b8-70f5-43fa-96f7-f8a276cd41fb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:30.254513 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ef5b8-70f5-43fa-96f7-f8a276cd41fb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:30.254786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ef5b8-70f5-43fa-96f7-f8a276cd41fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:30.255862 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ef5b8-70f5-43fa-96f7-f8a276cd41fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:30.257326 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ef5b8-70f5-43fa-96f7-f8a276cd41fb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:30.258876 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 26/56] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:30.264608 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:30.360777 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02785d7c-7cdd-44c3-b968-872ec42d65e8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:30.394580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69741-9fb8-4b7f-92b5-c3cab71a6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:30.395115 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69741-9fb8-4b7f-92b5-c3cab71a6e23 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:30.395397 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69741-9fb8-4b7f-92b5-c3cab71a6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:30.395673 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69741-9fb8-4b7f-92b5-c3cab71a6e23 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:30.396334 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69741-9fb8-4b7f-92b5-c3cab71a6e23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:30.397806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69741-9fb8-4b7f-92b5-c3cab71a6e23 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:30.415173 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:30.427174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 31/57] 10.222.0.66 () {60 vars in 1140 bytes} [Wed Sep 14 15:13:30 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:32.825586 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c51a-3c75-482f-8c0a-1496c6599f10 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:32.826136 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c51a-3c75-482f-8c0a-1496c6599f10 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:32.826136 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c51a-3c75-482f-8c0a-1496c6599f10 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:32.827494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 27/58] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:32.833208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a716e-e10d-4a34-8a28-467bce096c3b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:32.833604 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a716e-e10d-4a34-8a28-467bce096c3b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:32.833799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a716e-e10d-4a34-8a28-467bce096c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:32.852155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ef7a716e-e10d-4a34-8a28-467bce096c3b None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:32.853378 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ef7a716e-e10d-4a34-8a28-467bce096c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:32.918282 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 32/59] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:33.237191 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7c51a-3c75-482f-8c0a-1496c6599f10 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:33.341875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7c51a-3c75-482f-8c0a-1496c6599f10 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:33.367283 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:33.375495 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55effbc-9afa-47aa-b6ef-da70da63755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:33.376125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55effbc-9afa-47aa-b6ef-da70da63755b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:33.376412 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55effbc-9afa-47aa-b6ef-da70da63755b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:33.376690 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55effbc-9afa-47aa-b6ef-da70da63755b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:33.378681 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55effbc-9afa-47aa-b6ef-da70da63755b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:33.380124 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55effbc-9afa-47aa-b6ef-da70da63755b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:33.381701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 28/60] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:33.387170 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a716e-e10d-4a34-8a28-467bce096c3b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:33.484825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a716e-e10d-4a34-8a28-467bce096c3b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:33.510485 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:33.519365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fc7ca-829a-4247-be84-58cb620e2af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:33.519970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fc7ca-829a-4247-be84-58cb620e2af8 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:33.520253 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fc7ca-829a-4247-be84-58cb620e2af8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:33.520527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fc7ca-829a-4247-be84-58cb620e2af8 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:33.521183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fc7ca-829a-4247-be84-58cb620e2af8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:33.522674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fc7ca-829a-4247-be84-58cb620e2af8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:33.548724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 33/61] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:33 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:37.179003 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722b7a9-0064-4c8c-8a82-6af70cfcb94d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.180011 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722b7a9-0064-4c8c-8a82-6af70cfcb94d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.180496 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722b7a9-0064-4c8c-8a82-6af70cfcb94d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.182347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 29/62] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:37.188099 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb005-508b-4e15-b378-fefd099228f9 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.188537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb005-508b-4e15-b378-fefd099228f9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.188663 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbb005-508b-4e15-b378-fefd099228f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.216624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d7fbb005-508b-4e15-b378-fefd099228f9 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:37.218072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d7fbb005-508b-4e15-b378-fefd099228f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:37.294628 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 34/63] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:37.363055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06723363-693f-49b9-bcff-a2881e0472f5 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.363485 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06723363-693f-49b9-bcff-a2881e0472f5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.363867 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06723363-693f-49b9-bcff-a2881e0472f5 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.365603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 30/64] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:37.370981 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64b5e-a8d8-4572-9670-52148e88758f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.371429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64b5e-a8d8-4572-9670-52148e88758f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.371846 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64b5e-a8d8-4572-9670-52148e88758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.398314 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-beb64b5e-a8d8-4572-9670-52148e88758f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:37.399717 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-beb64b5e-a8d8-4572-9670-52148e88758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:37.481485 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 35/65] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:37.482214 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1964e4c-1338-41b7-968a-24c0eddc06f7 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.482809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1964e4c-1338-41b7-968a-24c0eddc06f7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.483457 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1964e4c-1338-41b7-968a-24c0eddc06f7 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.485472 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 31/66] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:37.493645 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecacb9-9476-4812-8cbe-ddb60f02b357 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.493926 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecacb9-9476-4812-8cbe-ddb60f02b357 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.494356 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecacb9-9476-4812-8cbe-ddb60f02b357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.514641 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-aeecacb9-9476-4812-8cbe-ddb60f02b357 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:37.516283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-aeecacb9-9476-4812-8cbe-ddb60f02b357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:37.554921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:37.596586 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 36/67] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:37.717505 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1964e4c-1338-41b7-968a-24c0eddc06f7 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:37.842063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecacb9-9476-4812-8cbe-ddb60f02b357 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:37.854877 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1964e4c-1338-41b7-968a-24c0eddc06f7 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:37.891205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee414b7c-c0f3-42fc-82fb-595760394e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:37.892070 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414b7c-c0f3-42fc-82fb-595760394e11 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.893171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414b7c-c0f3-42fc-82fb-595760394e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.893536 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414b7c-c0f3-42fc-82fb-595760394e11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.904903 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee414b7c-c0f3-42fc-82fb-595760394e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ee414b7c-c0f3-42fc-82fb-595760394e11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:37.910721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:37.911568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:37.912342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 32/68] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:37.912969 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a9c5-cd6f-4066-aa00-6cab760f4c8d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.913233 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a9c5-cd6f-4066-aa00-6cab760f4c8d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.913726 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a9c5-cd6f-4066-aa00-6cab760f4c8d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.915463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 33/69] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:37.920806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96891-6505-4178-b725-361263b3d761 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:37.921098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96891-6505-4178-b725-361263b3d761 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:37.921512 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96891-6505-4178-b725-361263b3d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:37.940480 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7ef96891-6505-4178-b725-361263b3d761 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:37.941718 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7ef96891-6505-4178-b725-361263b3d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:37.964217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecacb9-9476-4812-8cbe-ddb60f02b357 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:37.997953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.002362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d918-963f-44be-9276-1e7b9be5c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.003349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d918-963f-44be-9276-1e7b9be5c88f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.003636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d918-963f-44be-9276-1e7b9be5c88f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.003919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d918-963f-44be-9276-1e7b9be5c88f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.014326 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403d918-963f-44be-9276-1e7b9be5c88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:38.025345 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 34/70] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:13:38.025345 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef96891-6505-4178-b725-361263b3d761 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7403d918-963f-44be-9276-1e7b9be5c88f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:38.025580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:38.026365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 37/71] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:38.027141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d918-963f-44be-9276-1e7b9be5c88f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.061616 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.148178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d918-963f-44be-9276-1e7b9be5c88f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.153548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef96891-6505-4178-b725-361263b3d761 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.187289 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d519a-3a97-4770-8d81-47163519d8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.188179 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d519a-3a97-4770-8d81-47163519d8a3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.189077 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d519a-3a97-4770-8d81-47163519d8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.189389 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d519a-3a97-4770-8d81-47163519d8a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.190772 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.191394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.191734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.191959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.192880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:38.193044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:38.194443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:38.201892 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d519a-3a97-4770-8d81-47163519d8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:38.205427 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 35/72] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:38.205427 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-294d519a-3a97-4770-8d81-47163519d8a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:38.207435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:38.208418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:13:38.209384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:38.211414 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 38/73] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:38.212946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a878-c228-4d9f-ab4d-e0bb307e3e94 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.213265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a878-c228-4d9f-ab4d-e0bb307e3e94 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.213734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a878-c228-4d9f-ab4d-e0bb307e3e94 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.215876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 39/74] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:38.216726 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9a878-c228-4d9f-ab4d-e0bb307e3e94 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.267239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.325968 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.326209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005ba3-cc07-4801-a4d2-25e2510ff633 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.337375 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9a878-c228-4d9f-ab4d-e0bb307e3e94 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.363056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.363675 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.363962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.364242 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.364909 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:38.365220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:38.366670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:38.374380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352833d2-c6d6-4809-9f6f-01e92653f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.374814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 36/75] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:38.375127 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352833d2-c6d6-4809-9f6f-01e92653f18a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.375516 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352833d2-c6d6-4809-9f6f-01e92653f18a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.375609 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.375797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352833d2-c6d6-4809-9f6f-01e92653f18a None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.394821 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352833d2-c6d6-4809-9f6f-01e92653f18a None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:38.396290 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352833d2-c6d6-4809-9f6f-01e92653f18a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:38.397996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 40/76] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:38.399284 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c68fd-8eb5-465c-985c-253d42db26df None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.399529 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c68fd-8eb5-465c-985c-253d42db26df None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.399811 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c68fd-8eb5-465c-985c-253d42db26df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.418206 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-035c68fd-8eb5-465c-985c-253d42db26df None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:38.419411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-035c68fd-8eb5-465c-985c-253d42db26df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:38.482837 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c28666-f054-4a73-a57a-dd39411fd4ad None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.487144 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 41/77] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:38.487987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c68fd-8eb5-465c-985c-253d42db26df None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.494066 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.521518 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.522135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.522418 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.522741 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.523356 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:38.523664 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:38.525036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:38.538262 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 37/78] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:38.538262 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.584282 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.607574 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c68fd-8eb5-465c-985c-253d42db26df None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.634493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf221f-e0a8-442b-a2c1-79e2d17093d9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.647540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c0270-d9db-4a41-86f6-15be8e0c4dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.648708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c0270-d9db-4a41-86f6-15be8e0c4dd7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.649240 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c0270-d9db-4a41-86f6-15be8e0c4dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.649748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c0270-d9db-4a41-86f6-15be8e0c4dd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.665655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c0270-d9db-4a41-86f6-15be8e0c4dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-969c0270-d9db-4a41-86f6-15be8e0c4dd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:38.671776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:38.672614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:38.673447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 42/79] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:38.674181 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c0270-d9db-4a41-86f6-15be8e0c4dd7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.679172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b167d1-0d77-42ec-b48e-cd732001e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.679815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b167d1-0d77-42ec-b48e-cd732001e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.680097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b167d1-0d77-42ec-b48e-cd732001e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.680373 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b167d1-0d77-42ec-b48e-cd732001e9c7 None admin] PATH_INFO: `/v3/users/076e0863cb5c4974ba2d2e1b515b38f4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.681544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b167d1-0d77-42ec-b48e-cd732001e9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=076e0863cb5c4974ba2d2e1b515b38f4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:38.683050 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b167d1-0d77-42ec-b48e-cd732001e9c7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:38.689097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 38/80] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/users/076e0863cb5c4974ba2d2e1b515b38f4 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:38.689097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b167d1-0d77-42ec-b48e-cd732001e9c7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.730924 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.792598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b167d1-0d77-42ec-b48e-cd732001e9c7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.792919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c0270-d9db-4a41-86f6-15be8e0c4dd7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.826234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc47987-0950-415d-b311-a92c1a0defdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.826864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc47987-0950-415d-b311-a92c1a0defdd None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.827151 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc47987-0950-415d-b311-a92c1a0defdd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.827424 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc47987-0950-415d-b311-a92c1a0defdd None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.828566 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc47987-0950-415d-b311-a92c1a0defdd None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:38.830558 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc47987-0950-415d-b311-a92c1a0defdd None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:38.830941 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b670e-b528-4499-a5fa-0eb347925b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.831553 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b670e-b528-4499-a5fa-0eb347925b88 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.831837 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b670e-b528-4499-a5fa-0eb347925b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.832119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b670e-b528-4499-a5fa-0eb347925b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.832207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 39/81] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:38.832947 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc47987-0950-415d-b311-a92c1a0defdd None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:38.844162 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.905286 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b670e-b528-4499-a5fa-0eb347925b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:38.906806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b670e-b528-4499-a5fa-0eb347925b88 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:38.934644 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc47987-0950-415d-b311-a92c1a0defdd None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:38.943461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:38.974414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:38.975031 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:38.975319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:38.975601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:38.976304 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:38.976612 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:38.978046 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:38.986189 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 40/82] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:38.987013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.007536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 43/83] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:39.008668 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b670e-b528-4499-a5fa-0eb347925b88 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.051164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.087315 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbbccd-d226-44ee-9c3a-5a1b7d271c35 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.108697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b670e-b528-4499-a5fa-0eb347925b88 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.120233 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82cba6-191b-4a59-a311-37faca4a73af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.120844 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82cba6-191b-4a59-a311-37faca4a73af None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.121128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82cba6-191b-4a59-a311-37faca4a73af None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.121425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82cba6-191b-4a59-a311-37faca4a73af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.143280 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc058124-16f2-482f-bda6-8fc2085887a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.143906 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc058124-16f2-482f-bda6-8fc2085887a3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.144187 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc058124-16f2-482f-bda6-8fc2085887a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.144458 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc058124-16f2-482f-bda6-8fc2085887a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.145683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc058124-16f2-482f-bda6-8fc2085887a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.147141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc058124-16f2-482f-bda6-8fc2085887a3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.148699 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 44/84] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:39.149558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc058124-16f2-482f-bda6-8fc2085887a3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.165248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.194888 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82cba6-191b-4a59-a311-37faca4a73af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.196369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82cba6-191b-4a59-a311-37faca4a73af None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.255514 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc058124-16f2-482f-bda6-8fc2085887a3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.264755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.290181 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f0ee-6808-42c8-8208-f29e908cd5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.290792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f0ee-6808-42c8-8208-f29e908cd5c9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.291078 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f0ee-6808-42c8-8208-f29e908cd5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.291353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f0ee-6808-42c8-8208-f29e908cd5c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.296125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 41/85] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:39.297029 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82cba6-191b-4a59-a311-37faca4a73af None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.363503 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2f0ee-6808-42c8-8208-f29e908cd5c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.365024 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2f0ee-6808-42c8-8208-f29e908cd5c9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.367675 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.399522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82cba6-191b-4a59-a311-37faca4a73af None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.433618 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f659f4-fd5a-4eaa-8c2a-7a7849d65416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.434181 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f659f4-fd5a-4eaa-8c2a-7a7849d65416 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.434461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f659f4-fd5a-4eaa-8c2a-7a7849d65416 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.434735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f659f4-fd5a-4eaa-8c2a-7a7849d65416 None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.435866 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f659f4-fd5a-4eaa-8c2a-7a7849d65416 None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.437340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f659f4-fd5a-4eaa-8c2a-7a7849d65416 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.438960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 42/86] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:39.440323 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f659f4-fd5a-4eaa-8c2a-7a7849d65416 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.465358 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 45/87] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:39.470372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f0ee-6808-42c8-8208-f29e908cd5c9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.480112 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.546547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f659f4-fd5a-4eaa-8c2a-7a7849d65416 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.571007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f0ee-6808-42c8-8208-f29e908cd5c9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.581625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d93b6c-392b-4ac0-920e-ca4b2867699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.582266 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93b6c-392b-4ac0-920e-ca4b2867699a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.582548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93b6c-392b-4ac0-920e-ca4b2867699a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.582822 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93b6c-392b-4ac0-920e-ca4b2867699a None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.583952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d93b6c-392b-4ac0-920e-ca4b2867699a None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.585435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d93b6c-392b-4ac0-920e-ca4b2867699a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.587053 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 43/88] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:39.587901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d93b6c-392b-4ac0-920e-ca4b2867699a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.597796 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.607834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370134a-2e56-41db-97ee-a24f75f7ba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.608453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370134a-2e56-41db-97ee-a24f75f7ba1e None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.608738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370134a-2e56-41db-97ee-a24f75f7ba1e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.609010 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370134a-2e56-41db-97ee-a24f75f7ba1e None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.609695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370134a-2e56-41db-97ee-a24f75f7ba1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.611138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370134a-2e56-41db-97ee-a24f75f7ba1e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.632919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 46/89] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:39 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:39.633891 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370134a-2e56-41db-97ee-a24f75f7ba1e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.708686 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d93b6c-392b-4ac0-920e-ca4b2867699a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.717272 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.747766 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347467f-a85d-4796-8a8d-5a2096efd74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.748414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347467f-a85d-4796-8a8d-5a2096efd74b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.748755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347467f-a85d-4796-8a8d-5a2096efd74b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.749037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347467f-a85d-4796-8a8d-5a2096efd74b None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.750473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347467f-a85d-4796-8a8d-5a2096efd74b None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.751834 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347467f-a85d-4796-8a8d-5a2096efd74b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.759583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 44/90] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:39.760540 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347467f-a85d-4796-8a8d-5a2096efd74b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.764713 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370134a-2e56-41db-97ee-a24f75f7ba1e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.805692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d4b7b-ad84-447d-b9ff-4b732f7a0adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.806326 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d4b7b-ad84-447d-b9ff-4b732f7a0adb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.806612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d4b7b-ad84-447d-b9ff-4b732f7a0adb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.806889 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d4b7b-ad84-447d-b9ff-4b732f7a0adb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.847695 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:39.884215 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d4b7b-ad84-447d-b9ff-4b732f7a0adb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.885763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d4b7b-ad84-447d-b9ff-4b732f7a0adb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.886027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347467f-a85d-4796-8a8d-5a2096efd74b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:39.928342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df48ea-d246-4559-8b5c-6cda896dc613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:39.930108 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df48ea-d246-4559-8b5c-6cda896dc613 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:39.930108 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df48ea-d246-4559-8b5c-6cda896dc613 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:39.930108 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df48ea-d246-4559-8b5c-6cda896dc613 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:39.931885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df48ea-d246-4559-8b5c-6cda896dc613 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:39.934527 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df48ea-d246-4559-8b5c-6cda896dc613 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:39.934527 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 45/91] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:39.936457 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df48ea-d246-4559-8b5c-6cda896dc613 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:39.961012 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:40.011242 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 47/92] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:40.012117 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d4b7b-ad84-447d-b9ff-4b732f7a0adb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.066272 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df48ea-d246-4559-8b5c-6cda896dc613 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.108174 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.108914 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.109206 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.109540 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.110267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] RBAC: Adding query filter params (role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=787ddddee610423b947680623cefeb72, user.id=75bdb90f8d494c9ca53db67b74924493) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:40.110584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.112738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.119076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 46/93] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:39 2022] GET /identity/v3/role_assignments?user.id=75bdb90f8d494c9ca53db67b74924493&scope.project.id=787ddddee610423b947680623cefeb72&role.id=640205c745f84440b40441060cf8c9b4 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:40.119671 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.130218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:40.140676 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d4b7b-ad84-447d-b9ff-4b732f7a0adb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.184449 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.185086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.185405 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.185682 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.186418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=787ddddee610423b947680623cefeb72, user.id=076e0863cb5c4974ba2d2e1b515b38f4) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:40.186729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.188810 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.196147 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 48/94] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:40 2022] GET /identity/v3/role_assignments?user.id=076e0863cb5c4974ba2d2e1b515b38f4&scope.project.id=787ddddee610423b947680623cefeb72&role.id=6211512533b744e8b1ee9031113654ac => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:40.196923 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.233156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:40.323564 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8ad2-b7d1-4673-9c41-b2edcd5b3d3c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.328788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74966b1-9514-4ea0-b65a-fa0deb37bc2c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.377349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8380b-2b61-42e4-9766-b72db7ed0dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.377349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8380b-2b61-42e4-9766-b72db7ed0dda None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.377349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8380b-2b61-42e4-9766-b72db7ed0dda None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.377349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8380b-2b61-42e4-9766-b72db7ed0dda None admin] PATH_INFO: `/v3/projects/c88444c166bd4912bf08d2f9b961893b` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.378042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8380b-2b61-42e4-9766-b72db7ed0dda None admin] RBAC: Authorizing `identity:get_project(project_id=c88444c166bd4912bf08d2f9b961893b)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.378932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8380b-2b61-42e4-9766-b72db7ed0dda None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.381185 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 49/95] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:40 2022] GET /identity/v3/projects/c88444c166bd4912bf08d2f9b961893b => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:40.387534 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8380b-2b61-42e4-9766-b72db7ed0dda None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:40.414781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a0d68-6281-42b1-b604-8ca902109a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.415727 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0d68-6281-42b1-b604-8ca902109a2e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.416165 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0d68-6281-42b1-b604-8ca902109a2e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.416592 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0d68-6281-42b1-b604-8ca902109a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.417535 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a0d68-6281-42b1-b604-8ca902109a2e None admin] RBAC: Adding query filter params (role.id=a0aef3a60f6e4b7494f8707e8621dece, scope.project.id=787ddddee610423b947680623cefeb72, user.id=75bdb90f8d494c9ca53db67b74924493) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:40.418007 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a0d68-6281-42b1-b604-8ca902109a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.419715 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a0d68-6281-42b1-b604-8ca902109a2e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.432197 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 47/96] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:40 2022] GET /identity/v3/role_assignments?user.id=75bdb90f8d494c9ca53db67b74924493&scope.project.id=787ddddee610423b947680623cefeb72&role.id=a0aef3a60f6e4b7494f8707e8621dece => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:40.504520 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:40.511798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8380b-2b61-42e4-9766-b72db7ed0dda None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:40.568419 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a884c-5b37-4d74-9b5f-5e731b7b25ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:40.569058 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a884c-5b37-4d74-9b5f-5e731b7b25ca None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:40.569352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a884c-5b37-4d74-9b5f-5e731b7b25ca None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:40.569625 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a884c-5b37-4d74-9b5f-5e731b7b25ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:40.570365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a884c-5b37-4d74-9b5f-5e731b7b25ca None admin] RBAC: Adding query filter params (role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=c88444c166bd4912bf08d2f9b961893b, user.id=75bdb90f8d494c9ca53db67b74924493) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:40.570674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a884c-5b37-4d74-9b5f-5e731b7b25ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:40.572175 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a884c-5b37-4d74-9b5f-5e731b7b25ca None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:40.578858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 50/97] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:40 2022] GET /identity/v3/role_assignments?user.id=75bdb90f8d494c9ca53db67b74924493&scope.project.id=c88444c166bd4912bf08d2f9b961893b&role.id=640205c745f84440b40441060cf8c9b4 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:42.993617 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85972-48df-4bcd-a4a7-89d716038115 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:42.994156 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85972-48df-4bcd-a4a7-89d716038115 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:42.994156 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85972-48df-4bcd-a4a7-89d716038115 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:42.995518 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 48/98] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:43.000898 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447eb0c-a68e-4edc-81a2-7fd472724a32 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.001355 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447eb0c-a68e-4edc-81a2-7fd472724a32 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.001542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447eb0c-a68e-4edc-81a2-7fd472724a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.024331 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e447eb0c-a68e-4edc-81a2-7fd472724a32 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:43.025892 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e447eb0c-a68e-4edc-81a2-7fd472724a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:43.108510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 51/99] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:13:43.384957 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b70f95-497e-4a08-bb99-3a0725f87a59 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.385245 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b70f95-497e-4a08-bb99-3a0725f87a59 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.385721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b70f95-497e-4a08-bb99-3a0725f87a59 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.387220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 49/100] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:43.393196 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58e657-f1d6-4757-8407-0e2e84973709 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.393771 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58e657-f1d6-4757-8407-0e2e84973709 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.394258 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58e657-f1d6-4757-8407-0e2e84973709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.413477 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7c58e657-f1d6-4757-8407-0e2e84973709 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:43.414975 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7c58e657-f1d6-4757-8407-0e2e84973709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:43.488042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 52/101] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:43.504231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb0621-b332-4dce-9351-62c5bdcb1ed5 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.504844 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb0621-b332-4dce-9351-62c5bdcb1ed5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.505381 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb0621-b332-4dce-9351-62c5bdcb1ed5 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.506987 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 50/102] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:43.512942 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528e0c-fbe9-48bd-bbe7-02712c8cdc17 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.513243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528e0c-fbe9-48bd-bbe7-02712c8cdc17 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.514876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528e0c-fbe9-48bd-bbe7-02712c8cdc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.535338 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4c528e0c-fbe9-48bd-bbe7-02712c8cdc17 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:43.536546 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4c528e0c-fbe9-48bd-bbe7-02712c8cdc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:43.553160 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:43.611076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 53/103] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:43.644941 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb0621-b332-4dce-9351-62c5bdcb1ed5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:43.753711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:43.799806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb0621-b332-4dce-9351-62c5bdcb1ed5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:43.846851 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa9985-0c07-4800-9263-3450ebb2b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:43.847494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa9985-0c07-4800-9263-3450ebb2b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:43.847777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa9985-0c07-4800-9263-3450ebb2b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:43.848049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa9985-0c07-4800-9263-3450ebb2b0c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:43.849170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa9985-0c07-4800-9263-3450ebb2b0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:43.850627 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa9985-0c07-4800-9263-3450ebb2b0c6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:43.852350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 51/104] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:43.857673 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c528e0c-fbe9-48bd-bbe7-02712c8cdc17 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:43.978622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c528e0c-fbe9-48bd-bbe7-02712c8cdc17 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:44.023450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8ca32-c5aa-44d0-96fb-589acf0633b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:44.024093 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ca32-c5aa-44d0-96fb-589acf0633b6 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.024351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ca32-c5aa-44d0-96fb-589acf0633b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.024634 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ca32-c5aa-44d0-96fb-589acf0633b6 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.025325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8ca32-c5aa-44d0-96fb-589acf0633b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:44.026853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8ca32-c5aa-44d0-96fb-589acf0633b6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:44.036370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa9985-0c07-4800-9263-3450ebb2b0c6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.099578 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 54/105] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:13:43 2022] POST /identity/v3/projects => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:44.160208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8ca32-c5aa-44d0-96fb-589acf0633b6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.168394 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:44.196023 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa9985-0c07-4800-9263-3450ebb2b0c6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:44.273234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60270519-feb7-4cb7-b610-cc50e5b5b34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:44.275267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60270519-feb7-4cb7-b610-cc50e5b5b34e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.275587 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60270519-feb7-4cb7-b610-cc50e5b5b34e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.279024 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60270519-feb7-4cb7-b610-cc50e5b5b34e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.302810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:44.326087 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60270519-feb7-4cb7-b610-cc50e5b5b34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-60270519-feb7-4cb7-b610-cc50e5b5b34e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:44.331684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:44.332829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:44.333971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 52/106] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:44.342754 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4ced2-ba10-4084-a088-56fff70ce200 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.343042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4ced2-ba10-4084-a088-56fff70ce200 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.343321 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4ced2-ba10-4084-a088-56fff70ce200 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.344710 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 53/107] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:44.345491 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4ced2-ba10-4084-a088-56fff70ce200 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.352369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8ca32-c5aa-44d0-96fb-589acf0633b6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:44.396095 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186e331-1c94-4d61-b1de-e312add4be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:44.397064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186e331-1c94-4d61-b1de-e312add4be4d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.397619 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186e331-1c94-4d61-b1de-e312add4be4d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.398071 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186e331-1c94-4d61-b1de-e312add4be4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.413089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186e331-1c94-4d61-b1de-e312add4be4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8186e331-1c94-4d61-b1de-e312add4be4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:44.420985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:44.422062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:44.422904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:44.426196 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 55/108] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:44.427734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68ab2-938f-48bb-a181-35d671bc4dbb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.428178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68ab2-938f-48bb-a181-35d671bc4dbb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.428609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb68ab2-938f-48bb-a181-35d671bc4dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.449868 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3fb68ab2-938f-48bb-a181-35d671bc4dbb None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:44.451448 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3fb68ab2-938f-48bb-a181-35d671bc4dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:44.502101 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4ced2-ba10-4084-a088-56fff70ce200 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:44.534913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:44.541829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e7c90-a9e4-455a-a088-e88c583ad03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:44.543381 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e7c90-a9e4-455a-a088-e88c583ad03a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.543860 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e7c90-a9e4-455a-a088-e88c583ad03a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.544333 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e7c90-a9e4-455a-a088-e88c583ad03a None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.545195 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e7c90-a9e4-455a-a088-e88c583ad03a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:44.545710 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e7c90-a9e4-455a-a088-e88c583ad03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:44.546983 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 56/109] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:44.547485 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e7c90-a9e4-455a-a088-e88c583ad03a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:44.548011 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb68ab2-938f-48bb-a181-35d671bc4dbb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.560421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 54/110] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:44.562026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746518-2951-4d00-9c76-580b548d49f1 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.562501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746518-2951-4d00-9c76-580b548d49f1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.563002 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746518-2951-4d00-9c76-580b548d49f1 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.564439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 55/111] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:44.565617 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746518-2951-4d00-9c76-580b548d49f1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.669071 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:44.713158 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746518-2951-4d00-9c76-580b548d49f1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:44.749705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb68ab2-938f-48bb-a181-35d671bc4dbb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:44.749916 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc66c5-ffaf-48f0-bd54-9584273de084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:44.750353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc66c5-ffaf-48f0-bd54-9584273de084 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.750690 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc66c5-ffaf-48f0-bd54-9584273de084 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.750969 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc66c5-ffaf-48f0-bd54-9584273de084 None admin] PATH_INFO: `/v3/users/9a9a6c21d2b740dc95ce9ecd0d798cef` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.767034 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc66c5-ffaf-48f0-bd54-9584273de084 None admin] RBAC: Authorizing `identity:get_user(user_id=9a9a6c21d2b740dc95ce9ecd0d798cef)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:44.769164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc66c5-ffaf-48f0-bd54-9584273de084 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:44.771057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 56/112] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:44 2022] GET /identity/v3/users/9a9a6c21d2b740dc95ce9ecd0d798cef => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:44.772118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea123-2ceb-47a7-af3b-ddfe3b2cf944 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.772413 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea123-2ceb-47a7-af3b-ddfe3b2cf944 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.777036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea123-2ceb-47a7-af3b-ddfe3b2cf944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.796290 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c54ea123-2ceb-47a7-af3b-ddfe3b2cf944 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:44.797557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c54ea123-2ceb-47a7-af3b-ddfe3b2cf944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:44.849447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:44.850188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.850480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.850801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.851506 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:44.851849 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:44.853248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:44.863914 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 57/113] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:44.864917 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.874847 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 57/114] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:44.883564 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e702-0a89-42a7-8951-abcda965c4f8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:44.883852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e702-0a89-42a7-8951-abcda965c4f8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:44.884132 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e702-0a89-42a7-8951-abcda965c4f8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:44.886654 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 58/115] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:44.889155 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469e702-0a89-42a7-8951-abcda965c4f8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:44.940575 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:44.946624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:44.995292 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8a513-6340-4075-980d-a916a98949e8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.011441 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469e702-0a89-42a7-8951-abcda965c4f8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.041687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de8188-a11d-48a6-bd8e-0ca1df67e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.042331 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de8188-a11d-48a6-bd8e-0ca1df67e866 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.042629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de8188-a11d-48a6-bd8e-0ca1df67e866 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.042929 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de8188-a11d-48a6-bd8e-0ca1df67e866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.056007 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128f75-8cf5-4fb8-a0f5-eb810158bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.057621 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128f75-8cf5-4fb8-a0f5-eb810158bab8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.058164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128f75-8cf5-4fb8-a0f5-eb810158bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.058596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128f75-8cf5-4fb8-a0f5-eb810158bab8 None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.060164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d128f75-8cf5-4fb8-a0f5-eb810158bab8 None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:45.062548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d128f75-8cf5-4fb8-a0f5-eb810158bab8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:45.065477 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 59/116] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:44 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:45.066462 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128f75-8cf5-4fb8-a0f5-eb810158bab8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.120572 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de8188-a11d-48a6-bd8e-0ca1df67e866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:45.122222 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de8188-a11d-48a6-bd8e-0ca1df67e866 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:45.184467 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:45.206722 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128f75-8cf5-4fb8-a0f5-eb810158bab8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.225251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:45.243600 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301fa8f-c098-40bf-9811-bd682044a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.244231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301fa8f-c098-40bf-9811-bd682044a706 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.244580 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301fa8f-c098-40bf-9811-bd682044a706 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.244912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301fa8f-c098-40bf-9811-bd682044a706 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.245047 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 58/117] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:45.246429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b3b63-2460-413c-b315-39ab210b7ca5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.247104 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b3b63-2460-413c-b315-39ab210b7ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.247786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b3b63-2460-413c-b315-39ab210b7ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.256632 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301fa8f-c098-40bf-9811-bd682044a706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-0301fa8f-c098-40bf-9811-bd682044a706 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:45.261537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:45.262555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 60/118] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:45.269018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301fa8f-c098-40bf-9811-bd682044a706 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.273788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8f3b3b63-2460-413c-b315-39ab210b7ca5 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:45.275009 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8f3b3b63-2460-413c-b315-39ab210b7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:45.363051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 59/119] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:45.364223 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b3b63-2460-413c-b315-39ab210b7ca5 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.383538 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301fa8f-c098-40bf-9811-bd682044a706 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.420880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5167ba1-eca0-48a3-809e-c4a544f308f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.421661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5167ba1-eca0-48a3-809e-c4a544f308f8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.422019 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5167ba1-eca0-48a3-809e-c4a544f308f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.422374 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5167ba1-eca0-48a3-809e-c4a544f308f8 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.423591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5167ba1-eca0-48a3-809e-c4a544f308f8 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:45.425801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5167ba1-eca0-48a3-809e-c4a544f308f8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:45.427622 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 61/120] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:45 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:45.428620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5167ba1-eca0-48a3-809e-c4a544f308f8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.485958 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:45.487987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:45.510897 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b3b63-2460-413c-b315-39ab210b7ca5 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.557241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5167ba1-eca0-48a3-809e-c4a544f308f8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.559530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb3afc-a374-42b6-a86d-10525c36ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.561206 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb3afc-a374-42b6-a86d-10525c36ec1a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.561762 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb3afc-a374-42b6-a86d-10525c36ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.562175 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb3afc-a374-42b6-a86d-10525c36ec1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.576424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb3afc-a374-42b6-a86d-10525c36ec1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-bfbb3afc-a374-42b6-a86d-10525c36ec1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:45.582794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:45.583834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:13:45.584779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:45.587494 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 60/121] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:45.589001 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb3afc-a374-42b6-a86d-10525c36ec1a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.603602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db39c80-361c-4500-b95f-b96784bde8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.604251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db39c80-361c-4500-b95f-b96784bde8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.604538 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db39c80-361c-4500-b95f-b96784bde8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.604815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db39c80-361c-4500-b95f-b96784bde8d7 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.606058 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db39c80-361c-4500-b95f-b96784bde8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:45.607493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db39c80-361c-4500-b95f-b96784bde8d7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:45.609126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 62/122] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:45 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:45.615338 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db39c80-361c-4500-b95f-b96784bde8d7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.717092 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb3afc-a374-42b6-a86d-10525c36ec1a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.728134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db39c80-361c-4500-b95f-b96784bde8d7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.742554 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:45.755921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.756536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.756819 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.757089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.757993 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:45.758093 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:45.759465 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:45.766324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa05aa-5fa4-4255-afec-69b90485afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.766994 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa05aa-5fa4-4255-afec-69b90485afae None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.767283 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa05aa-5fa4-4255-afec-69b90485afae None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.767601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa05aa-5fa4-4255-afec-69b90485afae None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72/users/75bdb90f8d494c9ca53db67b74924493/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.769614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa05aa-5fa4-4255-afec-69b90485afae None admin] RBAC: Authorizing `identity:create_grant(project_id=787ddddee610423b947680623cefeb72, user_id=75bdb90f8d494c9ca53db67b74924493, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:45.771071 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa05aa-5fa4-4255-afec-69b90485afae None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:45.772622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 61/123] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:45.773286 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.782654 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:45.785960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 63/124] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:45 2022] PUT /identity/v3/projects/787ddddee610423b947680623cefeb72/users/75bdb90f8d494c9ca53db67b74924493/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:13:45.786700 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa05aa-5fa4-4255-afec-69b90485afae None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.924830 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa05aa-5fa4-4255-afec-69b90485afae None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.937398 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39652b-7237-4526-b852-a1bea77c06cd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:45.971231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.971857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.972145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.972461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.973380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] RBAC: Adding query filter params (role.id=a5724809c9964c4c9811dc88d60e3981, scope.project.id=787ddddee610423b947680623cefeb72, user.id=9a9a6c21d2b740dc95ce9ecd0d798cef) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:45.973733 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:45.975889 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:45.989388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 64/125] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:45 2022] GET /identity/v3/role_assignments?user.id=9a9a6c21d2b740dc95ce9ecd0d798cef&scope.project.id=787ddddee610423b947680623cefeb72&role.id=a5724809c9964c4c9811dc88d60e3981 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:45.991204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:45.993197 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:45.993866 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:45.994154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:45.994435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:45.995132 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:45.995501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:45.998675 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:46.010727 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 62/126] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:46.012027 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.036760 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:46.106601 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:46.141027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2959ada-8f86-4ddf-a56c-8c02c0b89996 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:46.188974 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff58d38-7f71-4bb7-8d63-3c1dec32abe6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:46.207316 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6411f5-f60a-4d3c-b620-80cadc37d701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:46.208571 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6411f5-f60a-4d3c-b620-80cadc37d701 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.209109 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6411f5-f60a-4d3c-b620-80cadc37d701 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.209576 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6411f5-f60a-4d3c-b620-80cadc37d701 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.222975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6411f5-f60a-4d3c-b620-80cadc37d701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-8d6411f5-f60a-4d3c-b620-80cadc37d701 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:46.228582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:46.229530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:46.230330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 65/127] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:46.235488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6411f5-f60a-4d3c-b620-80cadc37d701 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.269415 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86c335-1056-4dea-a6d0-4a41c8653eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:46.270166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c335-1056-4dea-a6d0-4a41c8653eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.270453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c335-1056-4dea-a6d0-4a41c8653eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.270731 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c335-1056-4dea-a6d0-4a41c8653eb5 None admin] PATH_INFO: `/v3/users/076e0863cb5c4974ba2d2e1b515b38f4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.271918 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86c335-1056-4dea-a6d0-4a41c8653eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=076e0863cb5c4974ba2d2e1b515b38f4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:46.273586 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86c335-1056-4dea-a6d0-4a41c8653eb5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:46.275177 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 63/128] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:46 2022] GET /identity/v3/users/076e0863cb5c4974ba2d2e1b515b38f4 => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:46.275943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86c335-1056-4dea-a6d0-4a41c8653eb5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.347407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:46.353118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6411f5-f60a-4d3c-b620-80cadc37d701 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:46.392170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050cc3c-abfe-459f-97ee-592615683c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:46.393455 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050cc3c-abfe-459f-97ee-592615683c88 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.393756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050cc3c-abfe-459f-97ee-592615683c88 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.394036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050cc3c-abfe-459f-97ee-592615683c88 None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.395207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050cc3c-abfe-459f-97ee-592615683c88 None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:46.396846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050cc3c-abfe-459f-97ee-592615683c88 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:46.398535 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 66/129] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:46 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:46.400045 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050cc3c-abfe-459f-97ee-592615683c88 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.517432 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050cc3c-abfe-459f-97ee-592615683c88 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:46.549088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902930d5-cc65-47a6-a9b6-7bf1628b4b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:46.549651 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86c335-1056-4dea-a6d0-4a41c8653eb5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:46.549842 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902930d5-cc65-47a6-a9b6-7bf1628b4b13 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.550117 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902930d5-cc65-47a6-a9b6-7bf1628b4b13 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.550452 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902930d5-cc65-47a6-a9b6-7bf1628b4b13 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.557421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902930d5-cc65-47a6-a9b6-7bf1628b4b13 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:46.557421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902930d5-cc65-47a6-a9b6-7bf1628b4b13 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:46.557421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 67/130] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:46 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:46.557421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902930d5-cc65-47a6-a9b6-7bf1628b4b13 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.615783 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:46.617001 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.617740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.618168 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.619258 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:46.619794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:46.621358 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:46.624364 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:46.629975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:46.637775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 64/131] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:46.644655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.745667 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902930d5-cc65-47a6-a9b6-7bf1628b4b13 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:46.788161 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c24b9-92d9-4531-a396-fb5774b70211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:46.789137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c24b9-92d9-4531-a396-fb5774b70211 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.789588 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c24b9-92d9-4531-a396-fb5774b70211 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.790026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c24b9-92d9-4531-a396-fb5774b70211 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.792074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c24b9-92d9-4531-a396-fb5774b70211 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:46.793914 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c24b9-92d9-4531-a396-fb5774b70211 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:46.800697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 68/132] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:46 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:46.802038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c24b9-92d9-4531-a396-fb5774b70211 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.859388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc25bf-4f2f-4be6-8ac5-c28c3d05a16a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:46.928988 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc9f7d-5476-42d6-9427-ddc42f64cefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:46.930673 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9f7d-5476-42d6-9427-ddc42f64cefb None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:46.932467 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9f7d-5476-42d6-9427-ddc42f64cefb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:46.932957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9f7d-5476-42d6-9427-ddc42f64cefb None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72/users/076e0863cb5c4974ba2d2e1b515b38f4/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:46.936676 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc9f7d-5476-42d6-9427-ddc42f64cefb None admin] RBAC: Authorizing `identity:create_grant(project_id=787ddddee610423b947680623cefeb72, user_id=076e0863cb5c4974ba2d2e1b515b38f4, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:46.939508 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc9f7d-5476-42d6-9427-ddc42f64cefb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:46.969212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 65/133] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:46 2022] PUT /identity/v3/projects/787ddddee610423b947680623cefeb72/users/076e0863cb5c4974ba2d2e1b515b38f4/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:13:46.970211 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc9f7d-5476-42d6-9427-ddc42f64cefb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:46.987363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:46.991380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c24b9-92d9-4531-a396-fb5774b70211 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:47.031514 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d84c7b-54f0-4254-8154-e53f33c769d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:47.032657 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84c7b-54f0-4254-8154-e53f33c769d7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:47.033223 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84c7b-54f0-4254-8154-e53f33c769d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:47.033817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84c7b-54f0-4254-8154-e53f33c769d7 None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.035302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d84c7b-54f0-4254-8154-e53f33c769d7 None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:47.037090 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d84c7b-54f0-4254-8154-e53f33c769d7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:47.039219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 69/134] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:46 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:47.044176 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:47.046399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7e048-ac67-496c-99a2-c52e0e123143 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:47.047088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7e048-ac67-496c-99a2-c52e0e123143 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:47.047803 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7e048-ac67-496c-99a2-c52e0e123143 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.051587 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 70/135] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:47.053067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7e048-ac67-496c-99a2-c52e0e123143 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:47.117839 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc9f7d-5476-42d6-9427-ddc42f64cefb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:47.152084 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb319-09f2-4169-8d54-2b930fa06690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:47.152873 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb319-09f2-4169-8d54-2b930fa06690 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:47.153215 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb319-09f2-4169-8d54-2b930fa06690 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:47.153542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb319-09f2-4169-8d54-2b930fa06690 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72/users/75bdb90f8d494c9ca53db67b74924493/roles/a0aef3a60f6e4b7494f8707e8621dece` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.155879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fb319-09f2-4169-8d54-2b930fa06690 None admin] RBAC: Authorizing `identity:create_grant(project_id=787ddddee610423b947680623cefeb72, user_id=75bdb90f8d494c9ca53db67b74924493, role_id=a0aef3a60f6e4b7494f8707e8621dece)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:47.157687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fb319-09f2-4169-8d54-2b930fa06690 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:47.182962 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 66/136] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:46 2022] PUT /identity/v3/projects/787ddddee610423b947680623cefeb72/users/75bdb90f8d494c9ca53db67b74924493/roles/a0aef3a60f6e4b7494f8707e8621dece => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:13:47.186647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5095c-9078-4a35-b2eb-4c89ffe1488d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:47.186947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5095c-9078-4a35-b2eb-4c89ffe1488d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:47.187217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5095c-9078-4a35-b2eb-4c89ffe1488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.229461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a2b5095c-9078-4a35-b2eb-4c89ffe1488d None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:47.231879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a2b5095c-9078-4a35-b2eb-4c89ffe1488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:47.287434 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7e048-ac67-496c-99a2-c52e0e123143 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:47.360439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d45869-ebcd-4ba0-95e4-149ddc5daa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:47.361098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d45869-ebcd-4ba0-95e4-149ddc5daa50 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:47.361963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d45869-ebcd-4ba0-95e4-149ddc5daa50 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:47.362252 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d45869-ebcd-4ba0-95e4-149ddc5daa50 None admin] PATH_INFO: `/v3/projects/c88444c166bd4912bf08d2f9b961893b` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.363587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 67/137] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:47.364332 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d45869-ebcd-4ba0-95e4-149ddc5daa50 None admin] RBAC: Authorizing `identity:get_project(project_id=c88444c166bd4912bf08d2f9b961893b)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:47.367444 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d45869-ebcd-4ba0-95e4-149ddc5daa50 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:47.367444 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 71/138] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:47 2022] GET /identity/v3/projects/c88444c166bd4912bf08d2f9b961893b => generated 312 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:47.373302 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5095c-9078-4a35-b2eb-4c89ffe1488d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:47.431220 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:47.488424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5095c-9078-4a35-b2eb-4c89ffe1488d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:47.525602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6392f02-044a-4a87-b4ec-d6ce2f72cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:47.526338 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6392f02-044a-4a87-b4ec-d6ce2f72cd4d None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:47.526616 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6392f02-044a-4a87-b4ec-d6ce2f72cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:47.526891 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6392f02-044a-4a87-b4ec-d6ce2f72cd4d None admin] PATH_INFO: `/v3/projects/c88444c166bd4912bf08d2f9b961893b/users/75bdb90f8d494c9ca53db67b74924493/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:47.528953 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6392f02-044a-4a87-b4ec-d6ce2f72cd4d None admin] RBAC: Authorizing `identity:create_grant(project_id=c88444c166bd4912bf08d2f9b961893b, user_id=75bdb90f8d494c9ca53db67b74924493, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:47.530467 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6392f02-044a-4a87-b4ec-d6ce2f72cd4d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:47.556462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 68/139] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:47 2022] PUT /identity/v3/projects/c88444c166bd4912bf08d2f9b961893b/users/75bdb90f8d494c9ca53db67b74924493/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:13:47.881389 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d45869-ebcd-4ba0-95e4-149ddc5daa50 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:47.928764 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:48.017274 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d45869-ebcd-4ba0-95e4-149ddc5daa50 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:48.066635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dba49-0ca7-4af5-bd6a-642a5f6ce4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:48.067272 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dba49-0ca7-4af5-bd6a-642a5f6ce4a8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:48.067556 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dba49-0ca7-4af5-bd6a-642a5f6ce4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:48.067830 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dba49-0ca7-4af5-bd6a-642a5f6ce4a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:48.069982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dba49-0ca7-4af5-bd6a-642a5f6ce4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:48.071443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dba49-0ca7-4af5-bd6a-642a5f6ce4a8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:48.073009 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 72/140] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:48.078838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6392f02-044a-4a87-b4ec-d6ce2f72cd4d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:48.230446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6392f02-044a-4a87-b4ec-d6ce2f72cd4d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:48.243512 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:48.279975 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bec24f-ef16-4fb4-88fe-e5a53c5bd6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:48.280738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bec24f-ef16-4fb4-88fe-e5a53c5bd6d2 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:48.281004 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bec24f-ef16-4fb4-88fe-e5a53c5bd6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:48.281399 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bec24f-ef16-4fb4-88fe-e5a53c5bd6d2 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:48.281983 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bec24f-ef16-4fb4-88fe-e5a53c5bd6d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:48.283487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bec24f-ef16-4fb4-88fe-e5a53c5bd6d2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:48.332639 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 69/141] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:48 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:48.872988 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d304b-debb-4595-ae05-62f0d138c79c None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:48.873541 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d304b-debb-4595-ae05-62f0d138c79c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:48.873624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d304b-debb-4595-ae05-62f0d138c79c None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:48.875167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 73/142] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:48.881692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8bbf3-e910-4e09-8db7-c2c146bdb32e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:48.881988 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8bbf3-e910-4e09-8db7-c2c146bdb32e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:48.882268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8bbf3-e910-4e09-8db7-c2c146bdb32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:48.901596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3aa8bbf3-e910-4e09-8db7-c2c146bdb32e None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:48.902807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3aa8bbf3-e910-4e09-8db7-c2c146bdb32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:48.995598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 70/143] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:49.361821 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b2350-7784-4b50-9903-e669e026d115 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:49.362110 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b2350-7784-4b50-9903-e669e026d115 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:49.362385 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b2350-7784-4b50-9903-e669e026d115 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:49.363907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 74/144] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:49.369053 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1549-8232-4ab6-8dc9-29e59c325809 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:49.369516 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1549-8232-4ab6-8dc9-29e59c325809 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:49.369703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1549-8232-4ab6-8dc9-29e59c325809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:49.394370 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5f4c1549-8232-4ab6-8dc9-29e59c325809 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:49.395576 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5f4c1549-8232-4ab6-8dc9-29e59c325809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:49.466022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 71/145] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:49.531297 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b2350-7784-4b50-9903-e669e026d115 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:49.653898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b2350-7784-4b50-9903-e669e026d115 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:49.662384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:49.697163 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e799e70-cd73-40c2-bd39-42e64d4fa1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:49.697834 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799e70-cd73-40c2-bd39-42e64d4fa1f1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:49.698115 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799e70-cd73-40c2-bd39-42e64d4fa1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:49.698390 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e799e70-cd73-40c2-bd39-42e64d4fa1f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:49.710085 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e799e70-cd73-40c2-bd39-42e64d4fa1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4e799e70-cd73-40c2-bd39-42e64d4fa1f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:49.714956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:49.715874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:49.716912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 75/146] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:49.721839 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1549-8232-4ab6-8dc9-29e59c325809 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:49.753594 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:49.845428 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1549-8232-4ab6-8dc9-29e59c325809 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:49.865654 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e799e70-cd73-40c2-bd39-42e64d4fa1f1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:49.891301 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:49.892021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:49.892318 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:49.892636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:49.893423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:49.893735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:49.895405 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:49.908608 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 72/147] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:49.914375 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:50.027755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:50.041795 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f3ee-7a07-4f8f-b337-bcc8036dfcf9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:50.080494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e799e70-cd73-40c2-bd39-42e64d4fa1f1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:50.101087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde121fc-e057-46e1-b0ce-c7835c24a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:50.101772 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde121fc-e057-46e1-b0ce-c7835c24a66d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:50.102056 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde121fc-e057-46e1-b0ce-c7835c24a66d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:50.102329 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde121fc-e057-46e1-b0ce-c7835c24a66d None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:50.104024 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde121fc-e057-46e1-b0ce-c7835c24a66d None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:50.105726 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde121fc-e057-46e1-b0ce-c7835c24a66d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:50.114047 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 73/148] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:49 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:50.119198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde121fc-e057-46e1-b0ce-c7835c24a66d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:50.178207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573d728-a9df-4567-9e9b-017fc795328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:50.179218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d728-a9df-4567-9e9b-017fc795328c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:50.179699 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d728-a9df-4567-9e9b-017fc795328c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:50.180166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d728-a9df-4567-9e9b-017fc795328c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:50.205489 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573d728-a9df-4567-9e9b-017fc795328c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-c573d728-a9df-4567-9e9b-017fc795328c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:50.211230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:50.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:13:50.212882 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:50.215499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 76/149] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:13:50.222180 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573d728-a9df-4567-9e9b-017fc795328c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:50.279165 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:50.300270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde121fc-e057-46e1-b0ce-c7835c24a66d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:50.354248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a869a2-2073-495d-a832-0db328036fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:50.354924 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a869a2-2073-495d-a832-0db328036fc4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:50.355209 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a869a2-2073-495d-a832-0db328036fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:50.355838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a869a2-2073-495d-a832-0db328036fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:50.385282 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:50.444618 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573d728-a9df-4567-9e9b-017fc795328c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:50.456126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a869a2-2073-495d-a832-0db328036fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:50.457729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a869a2-2073-495d-a832-0db328036fc4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:50.494970 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:50.495597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:50.495875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:50.496146 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:50.496823 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:50.497130 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:50.498558 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:50.514094 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 77/150] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:50.521103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:50.638132 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 74/151] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:50.643946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a869a2-2073-495d-a832-0db328036fc4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:50.678244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:50.701272 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321533d-68d6-4a15-9c5e-15a476b87ca5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:50.759487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:50.762545 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e44a5-12b2-47ac-a8c8-198d51044b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:50.763191 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e44a5-12b2-47ac-a8c8-198d51044b32 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:50.763587 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e44a5-12b2-47ac-a8c8-198d51044b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:50.763863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e44a5-12b2-47ac-a8c8-198d51044b32 None admin] PATH_INFO: `/v3/users/9a9a6c21d2b740dc95ce9ecd0d798cef` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:50.765360 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e44a5-12b2-47ac-a8c8-198d51044b32 None admin] RBAC: Authorizing `identity:get_user(user_id=9a9a6c21d2b740dc95ce9ecd0d798cef)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:50.767191 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e44a5-12b2-47ac-a8c8-198d51044b32 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:50.769344 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 78/152] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:50 2022] GET /identity/v3/users/9a9a6c21d2b740dc95ce9ecd0d798cef => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:50.775534 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e44a5-12b2-47ac-a8c8-198d51044b32 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:50.841657 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a869a2-2073-495d-a832-0db328036fc4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:50.913910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe94c-e19c-4c4b-9972-95c536fe8798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:50.914919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe94c-e19c-4c4b-9972-95c536fe8798 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:50.915399 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe94c-e19c-4c4b-9972-95c536fe8798 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:50.915871 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe94c-e19c-4c4b-9972-95c536fe8798 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:50.917241 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe94c-e19c-4c4b-9972-95c536fe8798 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:50.918932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe94c-e19c-4c4b-9972-95c536fe8798 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:50.921121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 75/153] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:50 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:50.926573 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe94c-e19c-4c4b-9972-95c536fe8798 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:50.952678 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e44a5-12b2-47ac-a8c8-198d51044b32 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:51.027924 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db73926-3720-4a93-879f-203aa6bc0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:51.028577 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73926-3720-4a93-879f-203aa6bc0e0b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.028861 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73926-3720-4a93-879f-203aa6bc0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.029135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73926-3720-4a93-879f-203aa6bc0e0b None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.034105 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db73926-3720-4a93-879f-203aa6bc0e0b None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:51.035579 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db73926-3720-4a93-879f-203aa6bc0e0b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:51.037349 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 79/154] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:50 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:51.043727 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db73926-3720-4a93-879f-203aa6bc0e0b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:51.088094 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:51.091579 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe94c-e19c-4c4b-9972-95c536fe8798 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:51.137482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:51.158450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe8ae7-de6a-4825-bf34-10187b7146f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:51.159070 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8ae7-de6a-4825-bf34-10187b7146f6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.159352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8ae7-de6a-4825-bf34-10187b7146f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.159626 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8ae7-de6a-4825-bf34-10187b7146f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.160353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe8ae7-de6a-4825-bf34-10187b7146f6 None admin] RBAC: Adding query filter params (role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=787ddddee610423b947680623cefeb72, user.id=75bdb90f8d494c9ca53db67b74924493) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:51.160660 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe8ae7-de6a-4825-bf34-10187b7146f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:51.162528 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe8ae7-de6a-4825-bf34-10187b7146f6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:51.179667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 76/155] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:50 2022] GET /identity/v3/role_assignments?user.id=75bdb90f8d494c9ca53db67b74924493&scope.project.id=787ddddee610423b947680623cefeb72&role.id=640205c745f84440b40441060cf8c9b4 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:51.232130 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db73926-3720-4a93-879f-203aa6bc0e0b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:51.284131 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49402764-0c5d-4fc6-a2b3-f8dc0a06be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:51.284806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402764-0c5d-4fc6-a2b3-f8dc0a06be96 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.285090 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402764-0c5d-4fc6-a2b3-f8dc0a06be96 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.285389 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49402764-0c5d-4fc6-a2b3-f8dc0a06be96 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72/users/9a9a6c21d2b740dc95ce9ecd0d798cef/roles/a5724809c9964c4c9811dc88d60e3981` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.287414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402764-0c5d-4fc6-a2b3-f8dc0a06be96 None admin] RBAC: Authorizing `identity:create_grant(project_id=787ddddee610423b947680623cefeb72, user_id=9a9a6c21d2b740dc95ce9ecd0d798cef, role_id=a5724809c9964c4c9811dc88d60e3981)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:51.288926 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49402764-0c5d-4fc6-a2b3-f8dc0a06be96 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:51.311754 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 80/156] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:13:51 2022] PUT /identity/v3/projects/787ddddee610423b947680623cefeb72/users/9a9a6c21d2b740dc95ce9ecd0d798cef/roles/a5724809c9964c4c9811dc88d60e3981 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:13:51.487274 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a6aa6-8dfb-4382-8d76-f0ec537416e5 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.487763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a6aa6-8dfb-4382-8d76-f0ec537416e5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.487763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a6aa6-8dfb-4382-8d76-f0ec537416e5 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.489099 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 77/157] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:51.493490 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a329-20d2-48a4-af63-7f2024d5a92b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.493773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a329-20d2-48a4-af63-7f2024d5a92b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.494058 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49a329-20d2-48a4-af63-7f2024d5a92b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.495445 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 81/158] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:51.497238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972064ce-61fa-4482-8ceb-7ebe5768bf67 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.497549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972064ce-61fa-4482-8ceb-7ebe5768bf67 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.497824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972064ce-61fa-4482-8ceb-7ebe5768bf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.520174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-972064ce-61fa-4482-8ceb-7ebe5768bf67 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:51.521409 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-972064ce-61fa-4482-8ceb-7ebe5768bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:51.526038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51ded-c029-4b07-aba5-51c8272d4b09 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.526320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51ded-c029-4b07-aba5-51c8272d4b09 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.526596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d51ded-c029-4b07-aba5-51c8272d4b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.555109 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-51d51ded-c029-4b07-aba5-51c8272d4b09 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:51.556964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-51d51ded-c029-4b07-aba5-51c8272d4b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:51.662696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 78/159] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:51.681900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 82/160] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:13:51.702007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89f644-bf52-4981-81a9-6cdcc0ae01f3 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.702367 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89f644-bf52-4981-81a9-6cdcc0ae01f3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.702568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89f644-bf52-4981-81a9-6cdcc0ae01f3 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.704175 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 79/161] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:51.717851 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316d7b-68c6-4f2a-a7fb-e13deec29a70 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:51.718151 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316d7b-68c6-4f2a-a7fb-e13deec29a70 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:51.718432 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316d7b-68c6-4f2a-a7fb-e13deec29a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:51.743573 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f0316d7b-68c6-4f2a-a7fb-e13deec29a70 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:51.744673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f0316d7b-68c6-4f2a-a7fb-e13deec29a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:51.755694 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:51.821250 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 83/162] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:52.141087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89f644-bf52-4981-81a9-6cdcc0ae01f3 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:52.286455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89f644-bf52-4981-81a9-6cdcc0ae01f3 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:52.322980 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:52.344547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400187d7-6d90-4360-82a8-a248f1e2f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:52.345181 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400187d7-6d90-4360-82a8-a248f1e2f080 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.345492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400187d7-6d90-4360-82a8-a248f1e2f080 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.345805 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400187d7-6d90-4360-82a8-a248f1e2f080 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.365526 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400187d7-6d90-4360-82a8-a248f1e2f080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-400187d7-6d90-4360-82a8-a248f1e2f080 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:52.370446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:52.371304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:52.372146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 80/163] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:52.376551 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0316d7b-68c6-4f2a-a7fb-e13deec29a70 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:52.379227 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400187d7-6d90-4360-82a8-a248f1e2f080 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:52.570485 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0316d7b-68c6-4f2a-a7fb-e13deec29a70 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:52.583654 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400187d7-6d90-4360-82a8-a248f1e2f080 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:52.629977 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:52.630587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.630863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.631132 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.631797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:52.632086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:52.633507 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:52.640902 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8ceb-21b2-4dd4-96e8-d655d562c08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:52.641581 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8ceb-21b2-4dd4-96e8-d655d562c08c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.641871 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8ceb-21b2-4dd4-96e8-d655d562c08c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.642149 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8ceb-21b2-4dd4-96e8-d655d562c08c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.647658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 81/164] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:52.648339 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:52.668058 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8ceb-21b2-4dd4-96e8-d655d562c08c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-c7dd8ceb-21b2-4dd4-96e8-d655d562c08c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:52.679533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:52.680471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:52.681281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:52.685164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 84/165] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:52.686067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8ceb-21b2-4dd4-96e8-d655d562c08c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:52.689458 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:52.720015 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:52.867293 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59868ef-6689-405e-83ce-c3ad7a03fc0e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:52.879299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8ceb-21b2-4dd4-96e8-d655d562c08c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:52.935437 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8262-5613-4d65-ad42-324778ff38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:52.936082 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8262-5613-4d65-ad42-324778ff38da None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.936362 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8262-5613-4d65-ad42-324778ff38da None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.936633 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8262-5613-4d65-ad42-324778ff38da None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.940269 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e8262-5613-4d65-ad42-324778ff38da None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:52.941771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e8262-5613-4d65-ad42-324778ff38da None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:52.943687 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 85/166] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:52 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:52.944552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8262-5613-4d65-ad42-324778ff38da None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:52.972277 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545c17-2e35-4a86-9d05-3edfce4d295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:52.973347 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545c17-2e35-4a86-9d05-3edfce4d295c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:52.973876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545c17-2e35-4a86-9d05-3edfce4d295c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:52.974349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545c17-2e35-4a86-9d05-3edfce4d295c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:52.994923 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545c17-2e35-4a86-9d05-3edfce4d295c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ff545c17-2e35-4a86-9d05-3edfce4d295c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:53.000790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:53.001694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:53.002521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:53.009658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 82/167] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:53.010691 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545c17-2e35-4a86-9d05-3edfce4d295c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:53.061699 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:53.109172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8262-5613-4d65-ad42-324778ff38da None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:53.175249 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545c17-2e35-4a86-9d05-3edfce4d295c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:53.176771 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:53.198623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:53.199255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:53.199539 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:53.199814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:53.200483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:53.200786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:53.202204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:53.211488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59922c-592e-492d-a71d-13fb2a70b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:53.212096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59922c-592e-492d-a71d-13fb2a70b93a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:53.212370 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59922c-592e-492d-a71d-13fb2a70b93a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:53.212644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59922c-592e-492d-a71d-13fb2a70b93a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:53.223538 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 86/168] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:53.224399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:53.285938 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59922c-592e-492d-a71d-13fb2a70b93a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:53.287424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59922c-592e-492d-a71d-13fb2a70b93a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:53.393703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:53.399522 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 83/169] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:53.400652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59922c-592e-492d-a71d-13fb2a70b93a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:53.447671 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c668-369a-4469-be07-1af81e6c2eda None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:53.489706 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:53.495544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:53.496187 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:53.496642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:53.496917 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:53.498035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:53.498343 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:53.499760 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:53.510631 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 87/170] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:53.511486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:53.581835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59922c-592e-492d-a71d-13fb2a70b93a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:53.619971 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abf189-2826-48ca-b0a2-bd2ae5f5ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:53.620704 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf189-2826-48ca-b0a2-bd2ae5f5ef05 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:53.620961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf189-2826-48ca-b0a2-bd2ae5f5ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:53.621244 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf189-2826-48ca-b0a2-bd2ae5f5ef05 None admin] PATH_INFO: `/v3/users/75bdb90f8d494c9ca53db67b74924493` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:53.622737 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abf189-2826-48ca-b0a2-bd2ae5f5ef05 None admin] RBAC: Authorizing `identity:get_user(user_id=75bdb90f8d494c9ca53db67b74924493)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:53.624177 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abf189-2826-48ca-b0a2-bd2ae5f5ef05 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:53.626137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 84/171] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:53 2022] GET /identity/v3/users/75bdb90f8d494c9ca53db67b74924493 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:53.626940 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abf189-2826-48ca-b0a2-bd2ae5f5ef05 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:53.701867 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:53.739162 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abf189-2826-48ca-b0a2-bd2ae5f5ef05 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:53.739627 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c5463-6b34-478e-b917-bb506149168a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:53.777538 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23439b86-a42e-43e4-859c-8f840354cbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:53.778194 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439b86-a42e-43e4-859c-8f840354cbf5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:53.778516 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439b86-a42e-43e4-859c-8f840354cbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:53.778798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23439b86-a42e-43e4-859c-8f840354cbf5 None admin] PATH_INFO: `/v3/users/076e0863cb5c4974ba2d2e1b515b38f4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:53.780088 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23439b86-a42e-43e4-859c-8f840354cbf5 None admin] RBAC: Authorizing `identity:get_user(user_id=076e0863cb5c4974ba2d2e1b515b38f4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:53.782050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23439b86-a42e-43e4-859c-8f840354cbf5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:53.790458 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 85/172] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:53 2022] GET /identity/v3/users/076e0863cb5c4974ba2d2e1b515b38f4 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:53.791317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23439b86-a42e-43e4-859c-8f840354cbf5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:53.805692 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb55a-36d9-459d-b871-406fd4a882b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:53.806345 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb55a-36d9-459d-b871-406fd4a882b4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:53.806625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb55a-36d9-459d-b871-406fd4a882b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:53.806899 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb55a-36d9-459d-b871-406fd4a882b4 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:53.808996 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efb55a-36d9-459d-b871-406fd4a882b4 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:53.810482 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efb55a-36d9-459d-b871-406fd4a882b4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:53.812117 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 88/173] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:53 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:53.812888 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb55a-36d9-459d-b871-406fd4a882b4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:53.902747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:53.904813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23439b86-a42e-43e4-859c-8f840354cbf5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:53.942939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4a0a-53d4-4530-9382-57724dbc2bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:53.943789 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4a0a-53d4-4530-9382-57724dbc2bc8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:53.944208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4a0a-53d4-4530-9382-57724dbc2bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:53.944617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4a0a-53d4-4530-9382-57724dbc2bc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:53.948559 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:53.973523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb55a-36d9-459d-b871-406fd4a882b4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:54.018910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4a0a-53d4-4530-9382-57724dbc2bc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:54.020453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4a0a-53d4-4530-9382-57724dbc2bc8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:54.031961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698609b7-d823-46ad-8bf7-3392f3175d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:54.032596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698609b7-d823-46ad-8bf7-3392f3175d37 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.032875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698609b7-d823-46ad-8bf7-3392f3175d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.033175 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698609b7-d823-46ad-8bf7-3392f3175d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.173347 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 86/174] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:54.174241 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4a0a-53d4-4530-9382-57724dbc2bc8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:54.213698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:54.230259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698609b7-d823-46ad-8bf7-3392f3175d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:54.231662 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698609b7-d823-46ad-8bf7-3392f3175d37 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:54.290434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4a0a-53d4-4530-9382-57724dbc2bc8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:54.369778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:54.371670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.375066 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.375589 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.376574 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] RBAC: Adding query filter params (role.id=a0aef3a60f6e4b7494f8707e8621dece, scope.project.id=787ddddee610423b947680623cefeb72, user.id=75bdb90f8d494c9ca53db67b74924493) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:54.377762 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:54.380760 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:54.396122 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 87/175] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:54 2022] GET /identity/v3/role_assignments?user.id=75bdb90f8d494c9ca53db67b74924493&scope.project.id=787ddddee610423b947680623cefeb72&role.id=a0aef3a60f6e4b7494f8707e8621dece => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:54.404317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:54.404921 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:54.506790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 89/176] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:54.511997 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3eccf-268a-4ece-9c94-7f98559ea7d9 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.515035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3eccf-268a-4ece-9c94-7f98559ea7d9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.515883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3eccf-268a-4ece-9c94-7f98559ea7d9 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.519188 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 90/177] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:54.523847 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45785fad-8e5f-4fae-bc98-e8e1d5aeccf8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.524404 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45785fad-8e5f-4fae-bc98-e8e1d5aeccf8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.524886 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45785fad-8e5f-4fae-bc98-e8e1d5aeccf8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.526494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 91/178] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:54.528725 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45785fad-8e5f-4fae-bc98-e8e1d5aeccf8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:54.605717 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:54.616608 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21595c-5efb-4ce1-9a7e-1aeaee26c1cb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:54.679931 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbfd5d-bd75-4eee-abc0-9214bf645c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:54.681372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfd5d-bd75-4eee-abc0-9214bf645c4e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.681868 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfd5d-bd75-4eee-abc0-9214bf645c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.682354 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfd5d-bd75-4eee-abc0-9214bf645c4e None admin] PATH_INFO: `/v3/projects/c88444c166bd4912bf08d2f9b961893b` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.683946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbfd5d-bd75-4eee-abc0-9214bf645c4e None admin] RBAC: Authorizing `identity:get_project(project_id=c88444c166bd4912bf08d2f9b961893b)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:54.685683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbfd5d-bd75-4eee-abc0-9214bf645c4e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:54.687818 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 88/179] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:54 2022] GET /identity/v3/projects/c88444c166bd4912bf08d2f9b961893b => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:54.689184 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e70d-a6c5-4612-af73-a7d6a179cf8e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.693144 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e70d-a6c5-4612-af73-a7d6a179cf8e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.693752 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e70d-a6c5-4612-af73-a7d6a179cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.715298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5de1e70d-a6c5-4612-af73-a7d6a179cf8e None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:54.716856 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5de1e70d-a6c5-4612-af73-a7d6a179cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:54.719435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45785fad-8e5f-4fae-bc98-e8e1d5aeccf8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:54.762292 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9e43c-d682-4e2c-8f7a-efc0b93f6683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:54.762860 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e43c-d682-4e2c-8f7a-efc0b93f6683 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.763138 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e43c-d682-4e2c-8f7a-efc0b93f6683 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.763410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e43c-d682-4e2c-8f7a-efc0b93f6683 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.764744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9e43c-d682-4e2c-8f7a-efc0b93f6683 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:54.766346 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9e43c-d682-4e2c-8f7a-efc0b93f6683 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:54.768433 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 92/180] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:54 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:54.769254 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b59928-a3c5-4f37-b950-3390aac28750 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.769597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b59928-a3c5-4f37-b950-3390aac28750 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.769930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b59928-a3c5-4f37-b950-3390aac28750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.791002 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-06b59928-a3c5-4f37-b950-3390aac28750 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:54.792728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-06b59928-a3c5-4f37-b950-3390aac28750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:54.804356 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 89/181] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:54.805415 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e70d-a6c5-4612-af73-a7d6a179cf8e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:54.817884 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:54.874686 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 93/182] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:54.876047 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb68834-c423-4798-830a-3e3bbba64d55 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.876339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb68834-c423-4798-830a-3e3bbba64d55 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.876615 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb68834-c423-4798-830a-3e3bbba64d55 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.878478 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 94/183] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:54.882072 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb68834-c423-4798-830a-3e3bbba64d55 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:54.923251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:54.931429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e70d-a6c5-4612-af73-a7d6a179cf8e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:54.968353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3acb2-de8e-4519-af96-172fb900b606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:54.969041 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3acb2-de8e-4519-af96-172fb900b606 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.969238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3acb2-de8e-4519-af96-172fb900b606 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.969544 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3acb2-de8e-4519-af96-172fb900b606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.970275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3acb2-de8e-4519-af96-172fb900b606 None admin] RBAC: Adding query filter params (role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=c88444c166bd4912bf08d2f9b961893b, user.id=75bdb90f8d494c9ca53db67b74924493) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:54.971106 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3acb2-de8e-4519-af96-172fb900b606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:54.972621 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3acb2-de8e-4519-af96-172fb900b606 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:54.979320 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 90/184] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:54 2022] GET /identity/v3/role_assignments?user.id=75bdb90f8d494c9ca53db67b74924493&scope.project.id=c88444c166bd4912bf08d2f9b961893b&role.id=640205c745f84440b40441060cf8c9b4 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:54.980360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e45ad-a062-4a9d-b550-2807d6b763aa None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.980654 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e45ad-a062-4a9d-b550-2807d6b763aa None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.980931 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e45ad-a062-4a9d-b550-2807d6b763aa None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:54.982201 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 91/185] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:54.983928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eedde-9452-446e-bcd4-8d80e8889349 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:54.984066 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eedde-9452-446e-bcd4-8d80e8889349 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:54.984278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eedde-9452-446e-bcd4-8d80e8889349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.009156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b74eedde-9452-446e-bcd4-8d80e8889349 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:55.011575 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b74eedde-9452-446e-bcd4-8d80e8889349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:55.013890 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb68834-c423-4798-830a-3e3bbba64d55 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.062246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaade48-13fc-4f63-baf2-f361d95d1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.063118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaade48-13fc-4f63-baf2-f361d95d1d9b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.063405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaade48-13fc-4f63-baf2-f361d95d1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.063682 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaade48-13fc-4f63-baf2-f361d95d1d9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.064474 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaade48-13fc-4f63-baf2-f361d95d1d9b None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=787ddddee610423b947680623cefeb72, user.id=076e0863cb5c4974ba2d2e1b515b38f4) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:55.065603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaade48-13fc-4f63-baf2-f361d95d1d9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:55.069981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaade48-13fc-4f63-baf2-f361d95d1d9b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:55.083860 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 95/186] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:54 2022] GET /identity/v3/role_assignments?user.id=076e0863cb5c4974ba2d2e1b515b38f4&scope.project.id=787ddddee610423b947680623cefeb72&role.id=6211512533b744e8b1ee9031113654ac => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:55.091521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada41c4-2ab0-4460-bd18-c34531990b73 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.091832 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada41c4-2ab0-4460-bd18-c34531990b73 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.092086 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada41c4-2ab0-4460-bd18-c34531990b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.132736 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2ada41c4-2ab0-4460-bd18-c34531990b73 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:55.134056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2ada41c4-2ab0-4460-bd18-c34531990b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:55.152262 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 92/187] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:55.154742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eedde-9452-446e-bcd4-8d80e8889349 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.179251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:55.304411 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 96/188] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:55.305238 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada41c4-2ab0-4460-bd18-c34531990b73 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.379375 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:55.404794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eedde-9452-446e-bcd4-8d80e8889349 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.459657 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6a72-04ef-4d05-8c69-22b60091a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.460674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6a72-04ef-4d05-8c69-22b60091a974 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.461476 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6a72-04ef-4d05-8c69-22b60091a974 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.461948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6a72-04ef-4d05-8c69-22b60091a974 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.478951 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada41c4-2ab0-4460-bd18-c34531990b73 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.480938 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b6a72-04ef-4d05-8c69-22b60091a974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1c9b6a72-04ef-4d05-8c69-22b60091a974 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:55.486996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:55.487876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:55.488719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 93/189] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:55.493800 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6a72-04ef-4d05-8c69-22b60091a974 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.525605 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8521f-a334-42dd-a475-1e3554787f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.526293 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8521f-a334-42dd-a475-1e3554787f36 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.527123 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8521f-a334-42dd-a475-1e3554787f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.527407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8521f-a334-42dd-a475-1e3554787f36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.528555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8521f-a334-42dd-a475-1e3554787f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:55.530315 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8521f-a334-42dd-a475-1e3554787f36 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:55.531637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 97/190] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:55.532426 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8521f-a334-42dd-a475-1e3554787f36 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.565109 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:55.642592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6a72-04ef-4d05-8c69-22b60091a974 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.661568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8521f-a334-42dd-a475-1e3554787f36 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.680042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.680652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.680939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.681215 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.681910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:55.682217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:55.683592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:55.692930 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 94/191] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:55.694060 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.700167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc21bb8-15fb-4c89-83c1-8c3e15cf89e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.700806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc21bb8-15fb-4c89-83c1-8c3e15cf89e4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.701089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc21bb8-15fb-4c89-83c1-8c3e15cf89e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.701393 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc21bb8-15fb-4c89-83c1-8c3e15cf89e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.708825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:55.714134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc21bb8-15fb-4c89-83c1-8c3e15cf89e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-bbc21bb8-15fb-4c89-83c1-8c3e15cf89e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:55.719091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:55.719975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 98/192] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:55.721985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc21bb8-15fb-4c89-83c1-8c3e15cf89e4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.796602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac19f-51e3-44c4-a6c1-147ea6269bce None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.804383 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:55.822514 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc21bb8-15fb-4c89-83c1-8c3e15cf89e4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:55.830510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5f7a1-2fb0-47f6-b675-9a14dd801c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.831114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f7a1-2fb0-47f6-b675-9a14dd801c3c None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.831393 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f7a1-2fb0-47f6-b675-9a14dd801c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.831671 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f7a1-2fb0-47f6-b675-9a14dd801c3c None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.832314 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5f7a1-2fb0-47f6-b675-9a14dd801c3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:55.833783 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5f7a1-2fb0-47f6-b675-9a14dd801c3c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:55.855575 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 95/193] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:55 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:55.857450 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc948400-c2a5-475a-bdf6-7daa80e40ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:55.858122 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc948400-c2a5-475a-bdf6-7daa80e40ac1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:55.858240 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5f7a1-2fb0-47f6-b675-9a14dd801c3c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.858414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc948400-c2a5-475a-bdf6-7daa80e40ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:55.858671 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc948400-c2a5-475a-bdf6-7daa80e40ac1 None admin] PATH_INFO: `/v3/users/852da8f93c5a4b9d8c273a5f4de7a247` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:55.875195 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc948400-c2a5-475a-bdf6-7daa80e40ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=852da8f93c5a4b9d8c273a5f4de7a247)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:55.876725 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc948400-c2a5-475a-bdf6-7daa80e40ac1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:55.879004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 99/194] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:55 2022] GET /identity/v3/users/852da8f93c5a4b9d8c273a5f4de7a247 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:55.879641 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc948400-c2a5-475a-bdf6-7daa80e40ac1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:55.939898 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:55.980606 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5f7a1-2fb0-47f6-b675-9a14dd801c3c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.004512 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc948400-c2a5-475a-bdf6-7daa80e40ac1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.019466 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68759155-d2a9-4a83-b1b2-ef8ab23eadb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.020248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759155-d2a9-4a83-b1b2-ef8ab23eadb7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.020530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759155-d2a9-4a83-b1b2-ef8ab23eadb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.020795 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759155-d2a9-4a83-b1b2-ef8ab23eadb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.033007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68759155-d2a9-4a83-b1b2-ef8ab23eadb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-68759155-d2a9-4a83-b1b2-ef8ab23eadb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:56.039446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:56.040380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:56.041174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 96/195] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:13:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:56.041871 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68759155-d2a9-4a83-b1b2-ef8ab23eadb7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:56.051952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.052576 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.052855 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.053126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.053830 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:56.054138 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:56.055553 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:56.064644 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 100/196] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:56.069420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:56.069840 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:56.168225 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68759155-d2a9-4a83-b1b2-ef8ab23eadb7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.187147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bdc8b-31dc-4bcb-8fa1-3d180bb60472 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.207115 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:56.217947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409812f-64d9-48a7-a80f-a1c5656af654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.218799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409812f-64d9-48a7-a80f-a1c5656af654 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.219226 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409812f-64d9-48a7-a80f-a1c5656af654 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.219643 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409812f-64d9-48a7-a80f-a1c5656af654 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.229637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.230260 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.230542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.230815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.231486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:56.231790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:56.233177 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:56.242219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 101/197] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:13:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:56.243503 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:56.320167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409812f-64d9-48a7-a80f-a1c5656af654 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:56.321606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:56.322652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409812f-64d9-48a7-a80f-a1c5656af654 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:56.379361 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9093-d602-4fd5-b032-f25417a0cb83 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.418696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f287499-1563-4547-987b-a07208d4675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.419473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287499-1563-4547-987b-a07208d4675c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.419583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287499-1563-4547-987b-a07208d4675c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.419854 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287499-1563-4547-987b-a07208d4675c None admin] PATH_INFO: `/v3/users/9a9a6c21d2b740dc95ce9ecd0d798cef` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.420986 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f287499-1563-4547-987b-a07208d4675c None admin] RBAC: Authorizing `identity:get_user(user_id=9a9a6c21d2b740dc95ce9ecd0d798cef)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:56.423017 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f287499-1563-4547-987b-a07208d4675c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:56.425451 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 102/198] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:56 2022] GET /identity/v3/users/9a9a6c21d2b740dc95ce9ecd0d798cef => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:56.430158 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f287499-1563-4547-987b-a07208d4675c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:56.450342 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 97/199] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:56.451964 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409812f-64d9-48a7-a80f-a1c5656af654 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:56.490513 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:56.540906 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f287499-1563-4547-987b-a07208d4675c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.574183 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:56.580484 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b082fb-a737-4819-a450-6106d3f26b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.581116 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b082fb-a737-4819-a450-6106d3f26b9c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.581886 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b082fb-a737-4819-a450-6106d3f26b9c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.582520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b082fb-a737-4819-a450-6106d3f26b9c None admin] PATH_INFO: `/v3/users/852da8f93c5a4b9d8c273a5f4de7a247` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.584294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b082fb-a737-4819-a450-6106d3f26b9c None admin] RBAC: Authorizing `identity:get_user(user_id=852da8f93c5a4b9d8c273a5f4de7a247)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:56.586393 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b082fb-a737-4819-a450-6106d3f26b9c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:56.588367 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 103/200] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:56 2022] GET /identity/v3/users/852da8f93c5a4b9d8c273a5f4de7a247 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:56.589342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b082fb-a737-4819-a450-6106d3f26b9c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:56.597554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409812f-64d9-48a7-a80f-a1c5656af654 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.639732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b097-ccb6-4603-a4a9-150e0dc24429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.640398 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b097-ccb6-4603-a4a9-150e0dc24429 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.640684 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b097-ccb6-4603-a4a9-150e0dc24429 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.640960 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b097-ccb6-4603-a4a9-150e0dc24429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.715697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467b097-ccb6-4603-a4a9-150e0dc24429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:56.717109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467b097-ccb6-4603-a4a9-150e0dc24429 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:56.722543 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b082fb-a737-4819-a450-6106d3f26b9c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.747222 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:56.765697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d05a5-aff8-4bc1-952a-fa25419f3941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.766825 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d05a5-aff8-4bc1-952a-fa25419f3941 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.767276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d05a5-aff8-4bc1-952a-fa25419f3941 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.768372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d05a5-aff8-4bc1-952a-fa25419f3941 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.770165 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d05a5-aff8-4bc1-952a-fa25419f3941 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:56.772042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d05a5-aff8-4bc1-952a-fa25419f3941 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:56.774141 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 104/201] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:56 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:56.775047 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d05a5-aff8-4bc1-952a-fa25419f3941 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:56.848262 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 98/202] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:56.849682 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b097-ccb6-4603-a4a9-150e0dc24429 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:56.857346 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:56.902530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d05a5-aff8-4bc1-952a-fa25419f3941 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.948446 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c731-be5b-484f-9588-45214eb93798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:56.949659 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c731-be5b-484f-9588-45214eb93798 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:56.950121 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c731-be5b-484f-9588-45214eb93798 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:56.950796 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c731-be5b-484f-9588-45214eb93798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:56.958272 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b097-ccb6-4603-a4a9-150e0dc24429 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:56.995259 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:57.005956 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:57.006646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:57.007001 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:57.007384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:57.008492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55, user.id=852da8f93c5a4b9d8c273a5f4de7a247) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:57.009350 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:57.011151 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:57.018852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 99/203] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:56 2022] GET /identity/v3/role_assignments?user.id=852da8f93c5a4b9d8c273a5f4de7a247&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=6211512533b744e8b1ee9031113654ac => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:57.024543 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:57.057178 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2c731-be5b-484f-9588-45214eb93798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:57.059032 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2c731-be5b-484f-9588-45214eb93798 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:57.150068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c31c9-1c5d-474b-85b2-35e50daef82f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:57.193552 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a243d-76d0-4b81-8d47-71825086e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:57.194310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a243d-76d0-4b81-8d47-71825086e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:57.194667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a243d-76d0-4b81-8d47-71825086e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:57.195576 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a243d-76d0-4b81-8d47-71825086e7d2 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:57.197162 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a243d-76d0-4b81-8d47-71825086e7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:57.198745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a243d-76d0-4b81-8d47-71825086e7d2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:57.200726 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 100/204] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:57 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:57.208936 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a243d-76d0-4b81-8d47-71825086e7d2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:57.225731 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:57.274445 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 105/205] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:13:57.291131 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c731-be5b-484f-9588-45214eb93798 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:57.342096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:57.398257 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a243d-76d0-4b81-8d47-71825086e7d2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:57.451356 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:57.451972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:57.452254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:57.452538 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:57.453373 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] RBAC: Adding query filter params (role.id=a5724809c9964c4c9811dc88d60e3981, scope.project.id=787ddddee610423b947680623cefeb72, user.id=9a9a6c21d2b740dc95ce9ecd0d798cef) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:57.453693 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:57.456669 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:57.463224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 101/206] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:57 2022] GET /identity/v3/role_assignments?user.id=9a9a6c21d2b740dc95ce9ecd0d798cef&scope.project.id=787ddddee610423b947680623cefeb72&role.id=a5724809c9964c4c9811dc88d60e3981 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:57.493757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c731-be5b-484f-9588-45214eb93798 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:57.532948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35261df7-bbdb-4d06-be0e-ef2fd4a34390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:57.533588 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261df7-bbdb-4d06-be0e-ef2fd4a34390 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:57.533872 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261df7-bbdb-4d06-be0e-ef2fd4a34390 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:57.534146 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261df7-bbdb-4d06-be0e-ef2fd4a34390 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:57.535384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35261df7-bbdb-4d06-be0e-ef2fd4a34390 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:57.536906 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35261df7-bbdb-4d06-be0e-ef2fd4a34390 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:57.539002 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 106/207] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:13:57 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:57.545103 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:57.674874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d907b-0d01-4fd6-a07e-966a6d4b7f0a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:57.700952 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:57.712897 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55136a40-57a4-4010-b32a-4245c36ce356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:57.713554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136a40-57a4-4010-b32a-4245c36ce356 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:57.713838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136a40-57a4-4010-b32a-4245c36ce356 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:57.714115 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55136a40-57a4-4010-b32a-4245c36ce356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:57.714856 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55136a40-57a4-4010-b32a-4245c36ce356 None admin] RBAC: Adding query filter params (role.id=a0aef3a60f6e4b7494f8707e8621dece, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55, user.id=852da8f93c5a4b9d8c273a5f4de7a247) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:57.715167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55136a40-57a4-4010-b32a-4245c36ce356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:57.716669 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55136a40-57a4-4010-b32a-4245c36ce356 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:57.723005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 102/208] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:13:57 2022] GET /identity/v3/role_assignments?user.id=852da8f93c5a4b9d8c273a5f4de7a247&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=a0aef3a60f6e4b7494f8707e8621dece => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:58.650965 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b4d2-86e0-4604-9eb0-a6c1a002e020 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.651485 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b4d2-86e0-4604-9eb0-a6c1a002e020 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.651485 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b4d2-86e0-4604-9eb0-a6c1a002e020 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.653126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 107/209] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:58.663420 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eeaba-5c8a-4535-9fc2-28a603ea5ebb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.663712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eeaba-5c8a-4535-9fc2-28a603ea5ebb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.664015 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eeaba-5c8a-4535-9fc2-28a603ea5ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.683374 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2b8eeaba-5c8a-4535-9fc2-28a603ea5ebb None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:58.684604 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2b8eeaba-5c8a-4535-9fc2-28a603ea5ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:58.727528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb6df-200f-4ce3-a2b2-2e4dae4418b5 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.727835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb6df-200f-4ce3-a2b2-2e4dae4418b5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.728084 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb6df-200f-4ce3-a2b2-2e4dae4418b5 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.729949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 108/210] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:58.743142 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86beb36d-f82e-4e11-bcd6-237e1d44300c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:58.743426 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86beb36d-f82e-4e11-bcd6-237e1d44300c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:58.743726 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86beb36d-f82e-4e11-bcd6-237e1d44300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:58.771638 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 103/211] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 14 15:13:58.784107 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-86beb36d-f82e-4e11-bcd6-237e1d44300c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:58.785443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-86beb36d-f82e-4e11-bcd6-237e1d44300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:58.819627 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:58.895064 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 109/212] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:13:59.120168 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eeaba-5c8a-4535-9fc2-28a603ea5ebb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:59.225247 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eeaba-5c8a-4535-9fc2-28a603ea5ebb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:59.243605 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:59.254771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86beb36d-f82e-4e11-bcd6-237e1d44300c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:59.262516 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc322e0-d7e4-471b-93c0-82970fc381c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:59.263376 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc322e0-d7e4-471b-93c0-82970fc381c0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.263831 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc322e0-d7e4-471b-93c0-82970fc381c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.264298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc322e0-d7e4-471b-93c0-82970fc381c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.276829 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc322e0-d7e4-471b-93c0-82970fc381c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7cc322e0-d7e4-471b-93c0-82970fc381c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:13:59.283951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:13:59.284862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:13:59.285683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:13:59.286933 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 104/213] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:13:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:13:59.293497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc322e0-d7e4-471b-93c0-82970fc381c0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:59.383915 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86beb36d-f82e-4e11-bcd6-237e1d44300c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:59.412056 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc322e0-d7e4-471b-93c0-82970fc381c0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:59.429871 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ac68b-c45c-461b-a85d-bf2f4fa0fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:59.430535 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac68b-c45c-461b-a85d-bf2f4fa0fa5a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.430824 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac68b-c45c-461b-a85d-bf2f4fa0fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.431058 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac68b-c45c-461b-a85d-bf2f4fa0fa5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.432339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ac68b-c45c-461b-a85d-bf2f4fa0fa5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:59.434872 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ac68b-c45c-461b-a85d-bf2f4fa0fa5a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:59.436912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 110/214] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:59.443233 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ac68b-c45c-461b-a85d-bf2f4fa0fa5a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:59.463841 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:59.464802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.465280 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.465818 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.466772 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:13:59.467275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:59.469122 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:59.479173 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:59.481298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 105/215] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:13:59.490331 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:59.542890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:59.577520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ac68b-c45c-461b-a85d-bf2f4fa0fa5a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:59.617126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fb1b6-5b5f-4cff-87eb-2c2fd75a7435 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:59.623823 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52994158-1e0b-47f6-8ded-c6d65ae84ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:59.624838 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52994158-1e0b-47f6-8ded-c6d65ae84ac1 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.625886 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52994158-1e0b-47f6-8ded-c6d65ae84ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.626370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52994158-1e0b-47f6-8ded-c6d65ae84ac1 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.627794 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52994158-1e0b-47f6-8ded-c6d65ae84ac1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:59.630406 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52994158-1e0b-47f6-8ded-c6d65ae84ac1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:59.655687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbab50f-747c-4492-b390-4292bbfa350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:59.656340 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbab50f-747c-4492-b390-4292bbfa350a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.656648 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbab50f-747c-4492-b390-4292bbfa350a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.656960 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbab50f-747c-4492-b390-4292bbfa350a None admin] PATH_INFO: `/v3/users/0f1cfec0be3b4a25b816790259613c56` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.671185 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 111/216] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:13:59 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:13:59.689688 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbab50f-747c-4492-b390-4292bbfa350a None admin] RBAC: Authorizing `identity:get_user(user_id=0f1cfec0be3b4a25b816790259613c56)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:59.691985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbab50f-747c-4492-b390-4292bbfa350a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:13:59.694934 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 106/217] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:13:59 2022] GET /identity/v3/users/0f1cfec0be3b4a25b816790259613c56 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:13:59.705954 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52994158-1e0b-47f6-8ded-c6d65ae84ac1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:13:59.814308 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:13:59.829125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52994158-1e0b-47f6-8ded-c6d65ae84ac1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:13:59.870598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9186eb-44fe-43bf-bb51-0adfa399bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:13:59.872328 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4d27-0e41-45ef-a385-afa478eccce2 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.872789 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4d27-0e41-45ef-a385-afa478eccce2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.872951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd4d27-0e41-45ef-a385-afa478eccce2 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.874110 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9186eb-44fe-43bf-bb51-0adfa399bf31 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.874618 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9186eb-44fe-43bf-bb51-0adfa399bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.874720 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 107/218] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:13:59.875171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9186eb-44fe-43bf-bb51-0adfa399bf31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.882198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213222de-4c18-4d4b-8cc0-eb86e32e7fc7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:13:59.882521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213222de-4c18-4d4b-8cc0-eb86e32e7fc7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:13:59.882759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213222de-4c18-4d4b-8cc0-eb86e32e7fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:13:59.906488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-213222de-4c18-4d4b-8cc0-eb86e32e7fc7 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:13:59.907802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-213222de-4c18-4d4b-8cc0-eb86e32e7fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:13:59.969119 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9186eb-44fe-43bf-bb51-0adfa399bf31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:13:59.971727 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9186eb-44fe-43bf-bb51-0adfa399bf31 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:00.004750 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 108/219] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:00.078606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:00.090710 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 112/220] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:00.097364 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213222de-4c18-4d4b-8cc0-eb86e32e7fc7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:00.128910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:00.207835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213222de-4c18-4d4b-8cc0-eb86e32e7fc7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:00.245157 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d53d-1dda-421a-82ee-f98e9137a77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:00.245824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d53d-1dda-421a-82ee-f98e9137a77b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:00.246109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d53d-1dda-421a-82ee-f98e9137a77b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:00.246382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d53d-1dda-421a-82ee-f98e9137a77b None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:00.247538 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d53d-1dda-421a-82ee-f98e9137a77b None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:00.248984 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d53d-1dda-421a-82ee-f98e9137a77b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:00.251469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 109/221] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:00 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:00.257617 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9186eb-44fe-43bf-bb51-0adfa399bf31 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:00.371403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d53d-1dda-421a-82ee-f98e9137a77b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:00.376159 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9186eb-44fe-43bf-bb51-0adfa399bf31 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:00.423549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851c8ac-2c26-4241-acc0-398c0dc41b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:00.424203 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851c8ac-2c26-4241-acc0-398c0dc41b2a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:00.424487 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851c8ac-2c26-4241-acc0-398c0dc41b2a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:00.424763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851c8ac-2c26-4241-acc0-398c0dc41b2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:00.425531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851c8ac-2c26-4241-acc0-398c0dc41b2a None admin] RBAC: Adding query filter params (role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55, user.id=0f1cfec0be3b4a25b816790259613c56) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:00.425844 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851c8ac-2c26-4241-acc0-398c0dc41b2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:00.427292 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851c8ac-2c26-4241-acc0-398c0dc41b2a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:00.433378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 113/222] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:00 2022] GET /identity/v3/role_assignments?user.id=0f1cfec0be3b4a25b816790259613c56&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=640205c745f84440b40441060cf8c9b4 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:00.434588 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293c30-5394-4981-92b9-22a342cf6a51 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:00.434873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293c30-5394-4981-92b9-22a342cf6a51 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:00.435149 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293c30-5394-4981-92b9-22a342cf6a51 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:00.436578 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 114/223] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:00.442505 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103260f-69d6-49ed-8ce4-cb9bf089d203 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:00.442841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103260f-69d6-49ed-8ce4-cb9bf089d203 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:00.443059 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103260f-69d6-49ed-8ce4-cb9bf089d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:00.473961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2103260f-69d6-49ed-8ce4-cb9bf089d203 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:00.475134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2103260f-69d6-49ed-8ce4-cb9bf089d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:00.506370 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:00.516103 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d53d-1dda-421a-82ee-f98e9137a77b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:00.547568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:00.556171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67b387-ab02-451e-8269-73e7863daa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:00.556813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67b387-ab02-451e-8269-73e7863daa14 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:00.557093 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67b387-ab02-451e-8269-73e7863daa14 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:00.557396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67b387-ab02-451e-8269-73e7863daa14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:00.569294 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67b387-ab02-451e-8269-73e7863daa14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:00.570567 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 115/224] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-6f67b387-ab02-451e-8269-73e7863daa14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:00.578824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:00.579794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:00.581126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 110/225] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:00.588355 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103260f-69d6-49ed-8ce4-cb9bf089d203 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:00.722427 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103260f-69d6-49ed-8ce4-cb9bf089d203 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:00.766216 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:00.766770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:00.767054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:00.767330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:00.768622 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:00.768930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:00.770405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:00.783103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 116/226] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:00.789108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67b387-ab02-451e-8269-73e7863daa14 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:00.909594 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67b387-ab02-451e-8269-73e7863daa14 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:00.946102 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b0c7f-bdbd-4894-9205-41924c22ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:00.946740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b0c7f-bdbd-4894-9205-41924c22ca53 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:00.947018 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b0c7f-bdbd-4894-9205-41924c22ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:00.947292 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b0c7f-bdbd-4894-9205-41924c22ca53 None admin] PATH_INFO: `/v3/users/852da8f93c5a4b9d8c273a5f4de7a247` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:00.948437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b0c7f-bdbd-4894-9205-41924c22ca53 None admin] RBAC: Authorizing `identity:get_user(user_id=852da8f93c5a4b9d8c273a5f4de7a247)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:00.949919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b0c7f-bdbd-4894-9205-41924c22ca53 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:00.951508 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 111/227] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:00 2022] GET /identity/v3/users/852da8f93c5a4b9d8c273a5f4de7a247 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:00.958195 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:01.005700 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b0c7f-bdbd-4894-9205-41924c22ca53 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:01.007616 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:01.038834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:01.115411 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43732ea-0a8a-4cb7-b674-c99b020d48c2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:01.146149 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b0c7f-bdbd-4894-9205-41924c22ca53 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:01.181891 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993aab95-812f-446f-948f-2d14a539d8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:01.182577 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993aab95-812f-446f-948f-2d14a539d8e7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:01.182862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993aab95-812f-446f-948f-2d14a539d8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:01.183138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993aab95-812f-446f-948f-2d14a539d8e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:01.194699 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993aab95-812f-446f-948f-2d14a539d8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-993aab95-812f-446f-948f-2d14a539d8e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:01.199670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:01.200567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:01.201407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 112/228] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:14:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:01.206994 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ffe04-8fa4-4bd3-93d8-27325baba4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:01.207946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ffe04-8fa4-4bd3-93d8-27325baba4ef None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:01.208441 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ffe04-8fa4-4bd3-93d8-27325baba4ef None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:01.208949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ffe04-8fa4-4bd3-93d8-27325baba4ef None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:01.209705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993aab95-812f-446f-948f-2d14a539d8e7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:01.210712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ffe04-8fa4-4bd3-93d8-27325baba4ef None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:01.212383 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ffe04-8fa4-4bd3-93d8-27325baba4ef None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:01.215568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 117/229] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:00 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:01.225162 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ffe04-8fa4-4bd3-93d8-27325baba4ef None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:01.402552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ffe04-8fa4-4bd3-93d8-27325baba4ef None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:01.406512 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:01.426741 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:01.436980 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993aab95-812f-446f-948f-2d14a539d8e7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:01.474513 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8aa36-5cbc-4bca-91fd-dd63ece561c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:01.475517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8aa36-5cbc-4bca-91fd-dd63ece561c9 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:01.475942 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8aa36-5cbc-4bca-91fd-dd63ece561c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:01.476358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8aa36-5cbc-4bca-91fd-dd63ece561c9 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/users/852da8f93c5a4b9d8c273a5f4de7a247/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:01.482923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8aa36-5cbc-4bca-91fd-dd63ece561c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55, user_id=852da8f93c5a4b9d8c273a5f4de7a247, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:01.484707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8aa36-5cbc-4bca-91fd-dd63ece561c9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:01.509290 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 118/230] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:01 2022] PUT /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/users/852da8f93c5a4b9d8c273a5f4de7a247/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:01.518238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:01.519108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:01.519584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:01.520027 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:01.520893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:01.521376 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:01.522909 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:01.532736 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 113/231] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:01.538952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8aa36-5cbc-4bca-91fd-dd63ece561c9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:01.699599 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8aa36-5cbc-4bca-91fd-dd63ece561c9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:01.751693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c480f-cda5-4f6f-83ce-76f21d3e2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:01.753509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c480f-cda5-4f6f-83ce-76f21d3e2a0a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:01.753943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c480f-cda5-4f6f-83ce-76f21d3e2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:01.754385 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c480f-cda5-4f6f-83ce-76f21d3e2a0a None admin] PATH_INFO: `/v3/users/852da8f93c5a4b9d8c273a5f4de7a247` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:01.758255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c480f-cda5-4f6f-83ce-76f21d3e2a0a None admin] RBAC: Authorizing `identity:get_user(user_id=852da8f93c5a4b9d8c273a5f4de7a247)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:01.759947 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c480f-cda5-4f6f-83ce-76f21d3e2a0a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:01.762146 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 119/232] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:01 2022] GET /identity/v3/users/852da8f93c5a4b9d8c273a5f4de7a247 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:01.767530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:01.886073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61051c0e-a08a-4805-9ff9-f50748632a84 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:01.926489 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24852a-3b75-4ed2-9a61-69ef5dfdbc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:01.927791 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24852a-3b75-4ed2-9a61-69ef5dfdbc7c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:01.928217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24852a-3b75-4ed2-9a61-69ef5dfdbc7c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:01.928654 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24852a-3b75-4ed2-9a61-69ef5dfdbc7c None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:01.930010 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24852a-3b75-4ed2-9a61-69ef5dfdbc7c None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:01.931640 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24852a-3b75-4ed2-9a61-69ef5dfdbc7c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:01.933459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 114/233] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:01 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:01.941094 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c480f-cda5-4f6f-83ce-76f21d3e2a0a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:01.997596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:02.076929 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c480f-cda5-4f6f-83ce-76f21d3e2a0a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:02.117867 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa76ef-de28-4303-8f06-50bc7ba17eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:02.118536 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa76ef-de28-4303-8f06-50bc7ba17eb8 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:02.118820 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa76ef-de28-4303-8f06-50bc7ba17eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:02.119098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa76ef-de28-4303-8f06-50bc7ba17eb8 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/users/852da8f93c5a4b9d8c273a5f4de7a247/roles/a0aef3a60f6e4b7494f8707e8621dece` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:02.121366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa76ef-de28-4303-8f06-50bc7ba17eb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55, user_id=852da8f93c5a4b9d8c273a5f4de7a247, role_id=a0aef3a60f6e4b7494f8707e8621dece)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:02.122896 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa76ef-de28-4303-8f06-50bc7ba17eb8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:02.145108 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 120/234] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:01 2022] PUT /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/users/852da8f93c5a4b9d8c273a5f4de7a247/roles/a0aef3a60f6e4b7494f8707e8621dece => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:02.899616 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cc1b1-7a0f-4d4c-971e-f2de8360ca0b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:02.900111 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cc1b1-7a0f-4d4c-971e-f2de8360ca0b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:02.900501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cc1b1-7a0f-4d4c-971e-f2de8360ca0b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:02.901989 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 115/235] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:02.907441 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a80729-a927-4b10-b388-034c3f1e39f6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:02.907924 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a80729-a927-4b10-b388-034c3f1e39f6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:02.908780 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a80729-a927-4b10-b388-034c3f1e39f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:02.927287 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-38a80729-a927-4b10-b388-034c3f1e39f6 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:02.928630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-38a80729-a927-4b10-b388-034c3f1e39f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:02.998056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 121/236] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:03.256622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d057-92d0-4d87-92fc-1cf5fe062698 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:03.257127 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d057-92d0-4d87-92fc-1cf5fe062698 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:03.257368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d057-92d0-4d87-92fc-1cf5fe062698 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:03.258828 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 116/237] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:03.264133 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64e30-c6b3-4279-9535-faad587a0ee9 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:03.264583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64e30-c6b3-4279-9535-faad587a0ee9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:03.264873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64e30-c6b3-4279-9535-faad587a0ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:03.284752 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0ed64e30-c6b3-4279-9535-faad587a0ee9 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:03.286063 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0ed64e30-c6b3-4279-9535-faad587a0ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:03.337410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:03.362306 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887445-7c9b-459f-ba9e-447f7b060242 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:03.362647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887445-7c9b-459f-ba9e-447f7b060242 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:03.362861 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887445-7c9b-459f-ba9e-447f7b060242 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:03.364205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 117/238] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:03.371549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251ae09-f338-4a7e-8056-b12e13a44cf7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:03.371873 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251ae09-f338-4a7e-8056-b12e13a44cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:03.372152 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251ae09-f338-4a7e-8056-b12e13a44cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:03.393413 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 122/239] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:03.394558 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed64e30-c6b3-4279-9535-faad587a0ee9 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:03.398032 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5251ae09-f338-4a7e-8056-b12e13a44cf7 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:03.399417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5251ae09-f338-4a7e-8056-b12e13a44cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:03.415950 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:03.546672 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed64e30-c6b3-4279-9535-faad587a0ee9 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:03.558613 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 118/240] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:03.596419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292d16a-dde1-4133-a454-573068b4da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:03.597370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292d16a-dde1-4133-a454-573068b4da8f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:03.597907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292d16a-dde1-4133-a454-573068b4da8f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:03.598374 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292d16a-dde1-4133-a454-573068b4da8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:03.599661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292d16a-dde1-4133-a454-573068b4da8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:03.601294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292d16a-dde1-4133-a454-573068b4da8f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:03.603054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 123/241] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:03.610494 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251ae09-f338-4a7e-8056-b12e13a44cf7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:03.730553 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292d16a-dde1-4133-a454-573068b4da8f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:03.743481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251ae09-f338-4a7e-8056-b12e13a44cf7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:03.782881 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831dd8f-cfca-465a-b72e-5438284b1df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:03.784027 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831dd8f-cfca-465a-b72e-5438284b1df4 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:03.784311 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831dd8f-cfca-465a-b72e-5438284b1df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:03.784587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831dd8f-cfca-465a-b72e-5438284b1df4 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:03.786098 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831dd8f-cfca-465a-b72e-5438284b1df4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:03.787536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831dd8f-cfca-465a-b72e-5438284b1df4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:03.813738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:03.828510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:03.833066 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 119/242] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:14:03 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:14:03.900896 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292d16a-dde1-4133-a454-573068b4da8f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:03.919954 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831dd8f-cfca-465a-b72e-5438284b1df4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:03.944104 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759bfa0-8238-4ffb-94ae-0de5a9ce45dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:03.944755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759bfa0-8238-4ffb-94ae-0de5a9ce45dd None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:03.945029 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759bfa0-8238-4ffb-94ae-0de5a9ce45dd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:03.945443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759bfa0-8238-4ffb-94ae-0de5a9ce45dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:03.959614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759bfa0-8238-4ffb-94ae-0de5a9ce45dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-f759bfa0-8238-4ffb-94ae-0de5a9ce45dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:03.964880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:03.965849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:03.966635 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 124/243] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:14:03.974603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759bfa0-8238-4ffb-94ae-0de5a9ce45dd None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:04.116049 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831dd8f-cfca-465a-b72e-5438284b1df4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:04.150959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:04.162466 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759bfa0-8238-4ffb-94ae-0de5a9ce45dd None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:04.163659 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c350cf-edc5-41d1-9409-1c544d8a0c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:04.164630 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c350cf-edc5-41d1-9409-1c544d8a0c84 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.165235 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c350cf-edc5-41d1-9409-1c544d8a0c84 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.165739 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c350cf-edc5-41d1-9409-1c544d8a0c84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.179773 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c350cf-edc5-41d1-9409-1c544d8a0c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c3c350cf-edc5-41d1-9409-1c544d8a0c84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:04.186299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:04.187212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:04.188029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 120/244] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:04.194637 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c350cf-edc5-41d1-9409-1c544d8a0c84 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:04.214983 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:04.215597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.215874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.216204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.216866 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:04.217468 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:04.219195 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:04.234712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 125/245] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:04.235989 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:04.276368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:04.338166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c350cf-edc5-41d1-9409-1c544d8a0c84 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:04.388847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:04.390760 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.391814 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.392587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.393435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd250e3-aa38-4d0a-90ce-9cd0e2b2cd53 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:04.394201 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:04.394716 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:04.396447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:04.413228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 121/246] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:04.417712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:04.440344 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa484e-9c56-4717-a603-359928ac47c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:04.441368 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa484e-9c56-4717-a603-359928ac47c8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.442047 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa484e-9c56-4717-a603-359928ac47c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.442768 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa484e-9c56-4717-a603-359928ac47c8 None admin] PATH_INFO: `/v3/users/9d63b01176bc4df6906fd5f812d7b50c` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.460846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa484e-9c56-4717-a603-359928ac47c8 None admin] RBAC: Authorizing `identity:get_user(user_id=9d63b01176bc4df6906fd5f812d7b50c)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:04.462791 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa484e-9c56-4717-a603-359928ac47c8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:04.464818 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 126/247] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:04 2022] GET /identity/v3/users/9d63b01176bc4df6906fd5f812d7b50c => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:04.470590 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa484e-9c56-4717-a603-359928ac47c8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:04.489027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:04.546407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dda990-2f03-4ce1-9451-ed8e31a7f1b0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:04.590244 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:04.605138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30283f-aeaa-4dfc-a614-6a2360f8ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:04.605916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30283f-aeaa-4dfc-a614-6a2360f8ab82 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.606206 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30283f-aeaa-4dfc-a614-6a2360f8ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.606482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30283f-aeaa-4dfc-a614-6a2360f8ab82 None admin] PATH_INFO: `/v3/users/0f1cfec0be3b4a25b816790259613c56` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.608747 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30283f-aeaa-4dfc-a614-6a2360f8ab82 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1cfec0be3b4a25b816790259613c56)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:04.610423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30283f-aeaa-4dfc-a614-6a2360f8ab82 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:04.612073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 122/248] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:04 2022] GET /identity/v3/users/0f1cfec0be3b4a25b816790259613c56 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:04.617763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30283f-aeaa-4dfc-a614-6a2360f8ab82 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:04.622783 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa484e-9c56-4717-a603-359928ac47c8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:04.671370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb5e8-b993-4f99-a375-f0fbf8ab42d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:04.672813 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb5e8-b993-4f99-a375-f0fbf8ab42d8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.673301 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb5e8-b993-4f99-a375-f0fbf8ab42d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.674316 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb5e8-b993-4f99-a375-f0fbf8ab42d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.743735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30283f-aeaa-4dfc-a614-6a2360f8ab82 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:04.769258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fb5e8-b993-4f99-a375-f0fbf8ab42d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:04.771261 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fb5e8-b993-4f99-a375-f0fbf8ab42d8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:04.787489 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645329e-71b5-4f7e-9a50-15c3f1e3f67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:04.787981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:04.788158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645329e-71b5-4f7e-9a50-15c3f1e3f67c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.788413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645329e-71b5-4f7e-9a50-15c3f1e3f67c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.788686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645329e-71b5-4f7e-9a50-15c3f1e3f67c None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.790165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645329e-71b5-4f7e-9a50-15c3f1e3f67c None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:04.792530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645329e-71b5-4f7e-9a50-15c3f1e3f67c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:04.795050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 123/249] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:04 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:04.802869 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645329e-71b5-4f7e-9a50-15c3f1e3f67c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:04.881876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:04.913413 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 127/250] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:04.915475 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2164591-c0d4-4848-ac8c-0849d2274c65 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:04.915959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2164591-c0d4-4848-ac8c-0849d2274c65 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:04.916573 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2164591-c0d4-4848-ac8c-0849d2274c65 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:04.918979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 128/251] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:04.919972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2164591-c0d4-4848-ac8c-0849d2274c65 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:04.962996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645329e-71b5-4f7e-9a50-15c3f1e3f67c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:05.023353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc3328-194a-4946-906a-5ca33aae35e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:05.025593 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3328-194a-4946-906a-5ca33aae35e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.027277 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3328-194a-4946-906a-5ca33aae35e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.027754 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3328-194a-4946-906a-5ca33aae35e4 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/users/0f1cfec0be3b4a25b816790259613c56/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.034478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc3328-194a-4946-906a-5ca33aae35e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55, user_id=0f1cfec0be3b4a25b816790259613c56, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:05.036173 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc3328-194a-4946-906a-5ca33aae35e4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:05.054653 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 124/252] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:04 2022] PUT /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/users/0f1cfec0be3b4a25b816790259613c56/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:05.055683 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2b8a-4bf2-43b7-a89d-a332ec36335c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.055976 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2b8a-4bf2-43b7-a89d-a332ec36335c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.056254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b2b8a-4bf2-43b7-a89d-a332ec36335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.098426 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2164591-c0d4-4848-ac8c-0849d2274c65 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:05.100152 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-330b2b8a-4bf2-43b7-a89d-a332ec36335c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:05.101447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-330b2b8a-4bf2-43b7-a89d-a332ec36335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:05.122041 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:05.152714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6822942-d354-468f-a1e9-140983b01a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:05.153890 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822942-d354-468f-a1e9-140983b01a92 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.154367 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822942-d354-468f-a1e9-140983b01a92 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.154926 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6822942-d354-468f-a1e9-140983b01a92 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.156323 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6822942-d354-468f-a1e9-140983b01a92 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:05.160057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6822942-d354-468f-a1e9-140983b01a92 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:05.162720 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 129/253] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:04 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:05.175101 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6822942-d354-468f-a1e9-140983b01a92 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:05.241397 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 125/254] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:05.314885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6822942-d354-468f-a1e9-140983b01a92 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:05.351352 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303c1ba-095d-4d99-9e64-f97da4773ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:05.352311 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c1ba-095d-4d99-9e64-f97da4773ca8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.352805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c1ba-095d-4d99-9e64-f97da4773ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.353282 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c1ba-095d-4d99-9e64-f97da4773ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.354303 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303c1ba-095d-4d99-9e64-f97da4773ca8 None admin] RBAC: Adding query filter params (role.id=a5724809c9964c4c9811dc88d60e3981, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55, user.id=9d63b01176bc4df6906fd5f812d7b50c) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:05.354868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303c1ba-095d-4d99-9e64-f97da4773ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:05.356536 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303c1ba-095d-4d99-9e64-f97da4773ca8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:05.365047 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 130/255] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:05 2022] GET /identity/v3/role_assignments?user.id=9d63b01176bc4df6906fd5f812d7b50c&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=a5724809c9964c4c9811dc88d60e3981 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:05.557407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027885d-3fe2-4473-9919-951277224756 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.557886 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027885d-3fe2-4473-9919-951277224756 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.557886 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027885d-3fe2-4473-9919-951277224756 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.559538 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 126/256] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:05.566041 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abe6ee-9a6c-4617-bf6b-d4043ae85ebf None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.566729 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abe6ee-9a6c-4617-bf6b-d4043ae85ebf None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.567195 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abe6ee-9a6c-4617-bf6b-d4043ae85ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.592092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-94abe6ee-9a6c-4617-bf6b-d4043ae85ebf None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:05.593765 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-94abe6ee-9a6c-4617-bf6b-d4043ae85ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:05.647752 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:05.691736 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 131/257] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:05.758747 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027885d-3fe2-4473-9919-951277224756 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:05.819134 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:05.880668 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027885d-3fe2-4473-9919-951277224756 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:05.917028 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d3592-afd3-4ae9-849d-25c027285404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:05.917695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3592-afd3-4ae9-849d-25c027285404 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:05.917979 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3592-afd3-4ae9-849d-25c027285404 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:05.918256 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3592-afd3-4ae9-849d-25c027285404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:05.930217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d3592-afd3-4ae9-849d-25c027285404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9a7d3592-afd3-4ae9-849d-25c027285404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:05.935352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:05.936210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:05.937764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 127/258] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:05.942630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abe6ee-9a6c-4617-bf6b-d4043ae85ebf None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:06.016025 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d3592-afd3-4ae9-849d-25c027285404 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:06.109346 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abe6ee-9a6c-4617-bf6b-d4043ae85ebf None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:06.164373 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:06.165013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:06.165293 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:06.165595 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:06.167191 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:06.167500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:06.168904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:06.188295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 132/259] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:06.195928 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:06.239464 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d3592-afd3-4ae9-849d-25c027285404 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:06.258266 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:06.275004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:06.329331 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55dc3-d31c-4ac9-bbef-6ab05cc9ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:06.330059 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55dc3-d31c-4ac9-bbef-6ab05cc9ff0c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:06.330344 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55dc3-d31c-4ac9-bbef-6ab05cc9ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:06.330617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55dc3-d31c-4ac9-bbef-6ab05cc9ff0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:06.352722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce55dc3-d31c-4ac9-bbef-6ab05cc9ff0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-bce55dc3-d31c-4ac9-bbef-6ab05cc9ff0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:06.358278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:06.359141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:06.360647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 128/260] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:14:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:06.365881 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55dc3-d31c-4ac9-bbef-6ab05cc9ff0c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:06.413395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad60793-74e5-40b5-b887-641ba4ac41a4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:06.469345 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b1d2e-65ae-4da3-9dee-da883b2f2074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:06.470626 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1d2e-65ae-4da3-9dee-da883b2f2074 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:06.471110 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1d2e-65ae-4da3-9dee-da883b2f2074 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:06.471585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1d2e-65ae-4da3-9dee-da883b2f2074 None admin] PATH_INFO: `/v3/users/852da8f93c5a4b9d8c273a5f4de7a247` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:06.473134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b1d2e-65ae-4da3-9dee-da883b2f2074 None admin] RBAC: Authorizing `identity:get_user(user_id=852da8f93c5a4b9d8c273a5f4de7a247)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:06.474911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b1d2e-65ae-4da3-9dee-da883b2f2074 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:06.476696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 133/261] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:06 2022] GET /identity/v3/users/852da8f93c5a4b9d8c273a5f4de7a247 => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:06.484119 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b1d2e-65ae-4da3-9dee-da883b2f2074 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:06.571456 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55dc3-d31c-4ac9-bbef-6ab05cc9ff0c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:06.613585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b1d2e-65ae-4da3-9dee-da883b2f2074 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:06.615509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:06.638828 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:06.639450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:06.639733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:06.640008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:06.640681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:06.640987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:06.642811 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:06.653131 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5b228-d682-4d69-978b-4bffba8f833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:06.654112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5b228-d682-4d69-978b-4bffba8f833c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:06.654588 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5b228-d682-4d69-978b-4bffba8f833c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:06.655159 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5b228-d682-4d69-978b-4bffba8f833c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:06.659916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 129/262] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:06.664654 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:06.722987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:06.731838 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5b228-d682-4d69-978b-4bffba8f833c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:06.733650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5b228-d682-4d69-978b-4bffba8f833c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:06.849784 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 134/263] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:06.858495 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5b228-d682-4d69-978b-4bffba8f833c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:06.860933 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:06.907932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45d235-7d12-483d-abd5-0a0e845b1025 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:06.995891 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e1a98-5460-491c-b84b-69ca02a8ec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:06.996543 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1a98-5460-491c-b84b-69ca02a8ec5e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:06.996890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1a98-5460-491c-b84b-69ca02a8ec5e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:06.997168 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1a98-5460-491c-b84b-69ca02a8ec5e None admin] PATH_INFO: `/v3/users/852da8f93c5a4b9d8c273a5f4de7a247` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:06.998498 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1a98-5460-491c-b84b-69ca02a8ec5e None admin] RBAC: Authorizing `identity:get_user(user_id=852da8f93c5a4b9d8c273a5f4de7a247)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:07.000074 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1a98-5460-491c-b84b-69ca02a8ec5e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:07.005813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 130/264] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:06 2022] GET /identity/v3/users/852da8f93c5a4b9d8c273a5f4de7a247 => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:07.011226 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e1a98-5460-491c-b84b-69ca02a8ec5e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:07.137304 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5b228-d682-4d69-978b-4bffba8f833c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:07.163484 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:07.169302 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e1a98-5460-491c-b84b-69ca02a8ec5e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:07.210894 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077607de-1d9a-47da-a9c1-d637654814c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:07.212817 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077607de-1d9a-47da-a9c1-d637654814c8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:07.213930 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077607de-1d9a-47da-a9c1-d637654814c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:07.214360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077607de-1d9a-47da-a9c1-d637654814c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:07.231643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139966-a91e-4b3b-93d3-6669719d3027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:07.232640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139966-a91e-4b3b-93d3-6669719d3027 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:07.233075 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139966-a91e-4b3b-93d3-6669719d3027 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:07.233561 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139966-a91e-4b3b-93d3-6669719d3027 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:07.235087 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18139966-a91e-4b3b-93d3-6669719d3027 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:07.243391 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18139966-a91e-4b3b-93d3-6669719d3027 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:07.246216 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 135/265] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:06 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:07.276537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139966-a91e-4b3b-93d3-6669719d3027 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:07.331704 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077607de-1d9a-47da-a9c1-d637654814c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:07.333606 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077607de-1d9a-47da-a9c1-d637654814c8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:07.471083 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:07.478997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:07.496048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 131/266] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:07.503079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077607de-1d9a-47da-a9c1-d637654814c8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:07.543305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139966-a91e-4b3b-93d3-6669719d3027 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:07.603584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:07.604252 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:07.604528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:07.604798 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:07.605604 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55, user.id=852da8f93c5a4b9d8c273a5f4de7a247) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:07.610600 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:07.613330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:07.626179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 136/267] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:07 2022] GET /identity/v3/role_assignments?user.id=852da8f93c5a4b9d8c273a5f4de7a247&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=6211512533b744e8b1ee9031113654ac => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:07.700497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077607de-1d9a-47da-a9c1-d637654814c8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:07.757064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9659df-2015-42ad-9e94-52f287a89b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:07.757715 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9659df-2015-42ad-9e94-52f287a89b7e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:07.757992 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9659df-2015-42ad-9e94-52f287a89b7e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:07.758260 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9659df-2015-42ad-9e94-52f287a89b7e None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:07.759399 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9659df-2015-42ad-9e94-52f287a89b7e None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:07.760987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9659df-2015-42ad-9e94-52f287a89b7e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:07.762742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 132/268] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:07 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:07.770077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:07.917918 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8215e-d8fc-4998-9b69-d10e2b0a7172 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:07.974139 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dee73-20d1-4c60-aed9-1a4c173c0e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:07.974779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dee73-20d1-4c60-aed9-1a4c173c0e43 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:07.975063 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dee73-20d1-4c60-aed9-1a4c173c0e43 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:07.975335 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dee73-20d1-4c60-aed9-1a4c173c0e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:07.976072 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dee73-20d1-4c60-aed9-1a4c173c0e43 None admin] RBAC: Adding query filter params (role.id=a0aef3a60f6e4b7494f8707e8621dece, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55, user.id=852da8f93c5a4b9d8c273a5f4de7a247) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:07.976384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dee73-20d1-4c60-aed9-1a4c173c0e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:07.977892 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dee73-20d1-4c60-aed9-1a4c173c0e43 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:07.979964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:07.985378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 137/269] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:07 2022] GET /identity/v3/role_assignments?user.id=852da8f93c5a4b9d8c273a5f4de7a247&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=a0aef3a60f6e4b7494f8707e8621dece => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:08.250834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630328-f7c6-4988-b244-07857dc8dc94 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:08.251223 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630328-f7c6-4988-b244-07857dc8dc94 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:08.251420 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630328-f7c6-4988-b244-07857dc8dc94 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:08.253173 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 133/270] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:08.258725 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778530-35a1-4c61-8c9c-b1e8dbd4c5b0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:08.259186 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778530-35a1-4c61-8c9c-b1e8dbd4c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:08.259261 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778530-35a1-4c61-8c9c-b1e8dbd4c5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:08.282601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4d778530-35a1-4c61-8c9c-b1e8dbd4c5b0 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:08.284367 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4d778530-35a1-4c61-8c9c-b1e8dbd4c5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:08.372633 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 138/271] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:08.514816 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0646e-b581-4a4a-bb5d-578b253c42b3 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:08.515106 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0646e-b581-4a4a-bb5d-578b253c42b3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:08.515415 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0646e-b581-4a4a-bb5d-578b253c42b3 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:08.516898 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 134/272] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:08.523132 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe296bd-dd55-4f88-8afd-9f9c8adeb111 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:08.523425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe296bd-dd55-4f88-8afd-9f9c8adeb111 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:08.523703 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe296bd-dd55-4f88-8afd-9f9c8adeb111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:08.546172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-dbe296bd-dd55-4f88-8afd-9f9c8adeb111 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:08.547406 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dbe296bd-dd55-4f88-8afd-9f9c8adeb111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:08.643702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 139/273] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:08.733209 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0646e-b581-4a4a-bb5d-578b253c42b3 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:08.773597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0cf1b-0735-497e-a79d-9b108dfe3476 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:08.773899 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0cf1b-0735-497e-a79d-9b108dfe3476 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:08.774077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0cf1b-0735-497e-a79d-9b108dfe3476 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:08.775655 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 140/274] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:08.782114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f46e5-bd16-41ed-b66e-fa723f5a7da1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:08.782505 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f46e5-bd16-41ed-b66e-fa723f5a7da1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:08.782880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f46e5-bd16-41ed-b66e-fa723f5a7da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:08.802218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5a0f46e5-bd16-41ed-b66e-fa723f5a7da1 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:08.803414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5a0f46e5-bd16-41ed-b66e-fa723f5a7da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:08.805309 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:08.848784 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0646e-b581-4a4a-bb5d-578b253c42b3 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:08.865124 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:08.893422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 141/275] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:08.896627 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2790a-576f-428c-a5fb-99c1b62e4c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:08.897269 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2790a-576f-428c-a5fb-99c1b62e4c89 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:08.897582 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2790a-576f-428c-a5fb-99c1b62e4c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:08.897859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2790a-576f-428c-a5fb-99c1b62e4c89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:08.908836 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2790a-576f-428c-a5fb-99c1b62e4c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-97a2790a-576f-428c-a5fb-99c1b62e4c89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:08.913708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:08.914596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:08.915390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 135/276] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:08.920944 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f46e5-bd16-41ed-b66e-fa723f5a7da1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.013874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2790a-576f-428c-a5fb-99c1b62e4c89 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.026113 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f46e5-bd16-41ed-b66e-fa723f5a7da1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.072788 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6093d-2bd5-4b84-b131-7f2ce09e0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.073428 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6093d-2bd5-4b84-b131-7f2ce09e0b8c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.073963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6093d-2bd5-4b84-b131-7f2ce09e0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.074241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6093d-2bd5-4b84-b131-7f2ce09e0b8c None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.075324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6093d-2bd5-4b84-b131-7f2ce09e0b8c None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:09.075906 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6093d-2bd5-4b84-b131-7f2ce09e0b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:09.077970 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6093d-2bd5-4b84-b131-7f2ce09e0b8c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:09.089462 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 142/277] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:09.090936 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b268078-dde1-4777-9cb3-e8cf67477e87 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.091219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b268078-dde1-4777-9cb3-e8cf67477e87 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.093762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b268078-dde1-4777-9cb3-e8cf67477e87 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.097406 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 143/278] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:09.097406 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b268078-dde1-4777-9cb3-e8cf67477e87 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.124799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2790a-576f-428c-a5fb-99c1b62e4c89 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.153052 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:09.158314 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:09.169238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04c2b-68c5-4246-bf1d-3962c01cedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.169915 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04c2b-68c5-4246-bf1d-3962c01cedca None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.170198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04c2b-68c5-4246-bf1d-3962c01cedca None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.170472 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04c2b-68c5-4246-bf1d-3962c01cedca None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.172388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b04c2b-68c5-4246-bf1d-3962c01cedca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:09.173912 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b04c2b-68c5-4246-bf1d-3962c01cedca None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:09.179887 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 136/279] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:09.179887 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1793-e22d-4639-b010-bba212ad6a15 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.179887 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1793-e22d-4639-b010-bba212ad6a15 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.179887 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1793-e22d-4639-b010-bba212ad6a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.196807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4c7f1793-e22d-4639-b010-bba212ad6a15 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:09.197670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4c7f1793-e22d-4639-b010-bba212ad6a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:09.210476 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b268078-dde1-4777-9cb3-e8cf67477e87 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.244740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48eb0-3e8d-4d07-86c0-3b28e0185fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.245411 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48eb0-3e8d-4d07-86c0-3b28e0185fcf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.245677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48eb0-3e8d-4d07-86c0-3b28e0185fcf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.245949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48eb0-3e8d-4d07-86c0-3b28e0185fcf None admin] PATH_INFO: `/v3/users/ec276a15c1be400c943f0130ecfbba82` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.259567 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f48eb0-3e8d-4d07-86c0-3b28e0185fcf None admin] RBAC: Authorizing `identity:get_user(user_id=ec276a15c1be400c943f0130ecfbba82)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:09.261022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f48eb0-3e8d-4d07-86c0-3b28e0185fcf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:09.262677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 144/280] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/users/ec276a15c1be400c943f0130ecfbba82 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:09.263423 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48eb0-3e8d-4d07-86c0-3b28e0185fcf None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.268949 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 137/281] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:09.269937 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f1793-e22d-4639-b010-bba212ad6a15 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.375430 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48eb0-3e8d-4d07-86c0-3b28e0185fcf None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.383286 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f1793-e22d-4639-b010-bba212ad6a15 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.385623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:09.410242 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:09.412452 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b6442-4f75-4136-b855-37469df2f6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.413251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b6442-4f75-4136-b855-37469df2f6bc None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.413567 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b6442-4f75-4136-b855-37469df2f6bc None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.414172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b6442-4f75-4136-b855-37469df2f6bc None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.414835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b6442-4f75-4136-b855-37469df2f6bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:09.416442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b6442-4f75-4136-b855-37469df2f6bc None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:09.422193 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab27a-94bc-4af9-8b36-a91ec70be808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.422494 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab27a-94bc-4af9-8b36-a91ec70be808 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.422747 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab27a-94bc-4af9-8b36-a91ec70be808 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.423016 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ab27a-94bc-4af9-8b36-a91ec70be808 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.435264 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ab27a-94bc-4af9-8b36-a91ec70be808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1a1ab27a-94bc-4af9-8b36-a91ec70be808 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:09.440872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:09.448537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:09.449365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:09.449967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 145/282] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:14:09 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:14:09.449967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b6442-4f75-4136-b855-37469df2f6bc None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.450092 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 138/283] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:09.450092 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab27a-94bc-4af9-8b36-a91ec70be808 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.579564 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ab27a-94bc-4af9-8b36-a91ec70be808 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.585576 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b6442-4f75-4136-b855-37469df2f6bc None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.620638 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.621263 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.621584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.621855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.622535 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:09.622893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:09.623981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.624301 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:09.624941 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.625435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.625859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.626806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] RBAC: Adding query filter params (role.id=640205c745f84440b40441060cf8c9b4, user.id=ec276a15c1be400c943f0130ecfbba82, scope.system=all) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:09.627302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:09.629078 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:09.638934 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 139/284] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:09.639141 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 146/285] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/role_assignments?user.id=ec276a15c1be400c943f0130ecfbba82&scope.system=all&role.id=640205c745f84440b40441060cf8c9b4 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:09.639253 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.643199 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.688610 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:09.706079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:09.781205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35906f-5e27-4e3e-90ad-bb9c9db35884 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.790777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fb81b-025e-4ab3-b107-d43bd7eeb19b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:09.838653 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9f572-51f2-4a00-b995-722425c71820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.839238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9f572-51f2-4a00-b995-722425c71820 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.839521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9f572-51f2-4a00-b995-722425c71820 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.839845 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9f572-51f2-4a00-b995-722425c71820 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.841043 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9204-0b9c-4b7c-8687-0df5c1c20ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:09.842296 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9204-0b9c-4b7c-8687-0df5c1c20ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:09.842810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9204-0b9c-4b7c-8687-0df5c1c20ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:09.843712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9204-0b9c-4b7c-8687-0df5c1c20ce9 None admin] PATH_INFO: `/v3/users/0f1cfec0be3b4a25b816790259613c56` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:09.845376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9204-0b9c-4b7c-8687-0df5c1c20ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1cfec0be3b4a25b816790259613c56)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:09.848090 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9204-0b9c-4b7c-8687-0df5c1c20ce9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:09.850471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 147/286] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/users/0f1cfec0be3b4a25b816790259613c56 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:09.854246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9f572-51f2-4a00-b995-722425c71820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:09.856236 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9204-0b9c-4b7c-8687-0df5c1c20ce9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-52e9f572-51f2-4a00-b995-722425c71820 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:09.859806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:09.860719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:09.862121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 140/287] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:09.867719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9f572-51f2-4a00-b995-722425c71820 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:09.973906 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:09.983001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9204-0b9c-4b7c-8687-0df5c1c20ce9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:10.007071 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9f572-51f2-4a00-b995-722425c71820 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:10.017210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:10.028808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4e0f2-3286-49e5-b20b-74516a31720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:10.029833 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e0f2-3286-49e5-b20b-74516a31720a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:10.030251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e0f2-3286-49e5-b20b-74516a31720a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:10.030754 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e0f2-3286-49e5-b20b-74516a31720a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:10.065763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:10.066616 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:10.067062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:10.067473 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:10.068268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:10.073761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:10.075180 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:10.099221 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 141/288] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:10.106094 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:10.131251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4e0f2-3286-49e5-b20b-74516a31720a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:10.134224 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4e0f2-3286-49e5-b20b-74516a31720a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:10.273963 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bab13-8a37-44e3-a047-0711b2ca2dbc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:10.293049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:10.305423 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 148/289] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:10.308638 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4e0f2-3286-49e5-b20b-74516a31720a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:10.325382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14720dc3-da4f-4ab0-abb1-63e10fd53fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:10.325382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14720dc3-da4f-4ab0-abb1-63e10fd53fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:10.325382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14720dc3-da4f-4ab0-abb1-63e10fd53fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:10.325382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14720dc3-da4f-4ab0-abb1-63e10fd53fb2 None admin] PATH_INFO: `/v3/users/9d63b01176bc4df6906fd5f812d7b50c` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:10.325986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14720dc3-da4f-4ab0-abb1-63e10fd53fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=9d63b01176bc4df6906fd5f812d7b50c)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:10.327448 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14720dc3-da4f-4ab0-abb1-63e10fd53fb2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:10.329026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 142/290] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:10 2022] GET /identity/v3/users/9d63b01176bc4df6906fd5f812d7b50c => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:10.335596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14720dc3-da4f-4ab0-abb1-63e10fd53fb2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:10.387047 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:10.491286 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4e0f2-3286-49e5-b20b-74516a31720a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:10.515334 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14720dc3-da4f-4ab0-abb1-63e10fd53fb2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:10.548386 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b744f-9635-488f-9a9a-fdd9660c5a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:10.549072 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b744f-9635-488f-9a9a-fdd9660c5a91 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:10.549377 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b744f-9635-488f-9a9a-fdd9660c5a91 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:10.549653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b744f-9635-488f-9a9a-fdd9660c5a91 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:10.550782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b744f-9635-488f-9a9a-fdd9660c5a91 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:10.552339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b744f-9635-488f-9a9a-fdd9660c5a91 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:10.559220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 149/291] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:10 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:10.560483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b744f-9635-488f-9a9a-fdd9660c5a91 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:10.591275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911817f-2b87-4050-a2c9-673e64186d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:10.592283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911817f-2b87-4050-a2c9-673e64186d46 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:10.592761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911817f-2b87-4050-a2c9-673e64186d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:10.593251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911817f-2b87-4050-a2c9-673e64186d46 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:10.598030 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911817f-2b87-4050-a2c9-673e64186d46 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:10.599728 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911817f-2b87-4050-a2c9-673e64186d46 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:10.601613 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 143/292] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:10 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:10.610271 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911817f-2b87-4050-a2c9-673e64186d46 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:10.677393 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:10.744981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b744f-9635-488f-9a9a-fdd9660c5a91 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:10.777364 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911817f-2b87-4050-a2c9-673e64186d46 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:10.779957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:10.811648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb909-6946-44ef-9e62-fa64c62fb1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:10.812637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb909-6946-44ef-9e62-fa64c62fb1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:10.813113 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb909-6946-44ef-9e62-fa64c62fb1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:10.813618 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb909-6946-44ef-9e62-fa64c62fb1a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:10.815060 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eb909-6946-44ef-9e62-fa64c62fb1a0 None admin] RBAC: Adding query filter params (role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55, user.id=0f1cfec0be3b4a25b816790259613c56) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:10.818246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eb909-6946-44ef-9e62-fa64c62fb1a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:10.819915 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eb909-6946-44ef-9e62-fa64c62fb1a0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:10.828298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 150/293] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:10 2022] GET /identity/v3/role_assignments?user.id=0f1cfec0be3b4a25b816790259613c56&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=640205c745f84440b40441060cf8c9b4 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:10.852548 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22e1bb-11b9-4c12-8de0-5a802f3ce67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:10.853974 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e1bb-11b9-4c12-8de0-5a802f3ce67e None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:10.854478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e1bb-11b9-4c12-8de0-5a802f3ce67e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:10.854966 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e1bb-11b9-4c12-8de0-5a802f3ce67e None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/users/9d63b01176bc4df6906fd5f812d7b50c/roles/a5724809c9964c4c9811dc88d60e3981` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:10.863270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22e1bb-11b9-4c12-8de0-5a802f3ce67e None admin] RBAC: Authorizing `identity:create_grant(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55, user_id=9d63b01176bc4df6906fd5f812d7b50c, role_id=a5724809c9964c4c9811dc88d60e3981)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:10.865136 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22e1bb-11b9-4c12-8de0-5a802f3ce67e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:10.896198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 144/294] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:10 2022] PUT /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/users/9d63b01176bc4df6906fd5f812d7b50c/roles/a5724809c9964c4c9811dc88d60e3981 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:12.379494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074947-ec4f-4cc7-9b3b-3e858510981e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:12.380541 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074947-ec4f-4cc7-9b3b-3e858510981e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:12.381010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074947-ec4f-4cc7-9b3b-3e858510981e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:12.382853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 151/295] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:12.388392 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b1ca6-a546-44e6-9a5d-6c6aa4572999 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:12.389388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b1ca6-a546-44e6-9a5d-6c6aa4572999 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:12.389855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b1ca6-a546-44e6-9a5d-6c6aa4572999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:12.391457 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec473-4c8a-491e-b2a0-787a4bcbbe90 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:12.391733 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec473-4c8a-491e-b2a0-787a4bcbbe90 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:12.392040 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec473-4c8a-491e-b2a0-787a4bcbbe90 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:12.393575 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 152/296] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:12.398775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4896d0-594b-4ea1-a484-45fbb7f44499 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:12.399055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4896d0-594b-4ea1-a484-45fbb7f44499 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:12.399399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4896d0-594b-4ea1-a484-45fbb7f44499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:12.416060 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-351b1ca6-a546-44e6-9a5d-6c6aa4572999 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:12.417267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-351b1ca6-a546-44e6-9a5d-6c6aa4572999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:12.419219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7a4896d0-594b-4ea1-a484-45fbb7f44499 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:12.420917 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7a4896d0-594b-4ea1-a484-45fbb7f44499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:12.489336 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 145/297] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:12.490646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69a451-d189-4f15-8402-419384e06615 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:12.490941 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69a451-d189-4f15-8402-419384e06615 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:12.491227 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69a451-d189-4f15-8402-419384e06615 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:12.492446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 146/298] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:12.497802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076423-67dc-4717-9b9b-b8dd378ff8bc None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:12.498090 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076423-67dc-4717-9b9b-b8dd378ff8bc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:12.498371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076423-67dc-4717-9b9b-b8dd378ff8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:12.501569 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 153/299] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:12.521145 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e1076423-67dc-4717-9b9b-b8dd378ff8bc None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:12.522719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e1076423-67dc-4717-9b9b-b8dd378ff8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:12.593360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 147/300] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:12.812511 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4896d0-594b-4ea1-a484-45fbb7f44499 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:12.841987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1076423-67dc-4717-9b9b-b8dd378ff8bc None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:12.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:12.879172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:12.925339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4896d0-594b-4ea1-a484-45fbb7f44499 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:12.964725 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177db46b-7aef-4b37-bb02-ff9ffe738b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:12.965534 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177db46b-7aef-4b37-bb02-ff9ffe738b26 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:12.965795 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177db46b-7aef-4b37-bb02-ff9ffe738b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:12.966110 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177db46b-7aef-4b37-bb02-ff9ffe738b26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:12.979615 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177db46b-7aef-4b37-bb02-ff9ffe738b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-177db46b-7aef-4b37-bb02-ff9ffe738b26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:12.985232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:12.986204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:12.987522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:12.988133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1076423-67dc-4717-9b9b-b8dd378ff8bc None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:12.988204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 154/301] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:12.988204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177db46b-7aef-4b37-bb02-ff9ffe738b26 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:13.022979 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a954-3e68-498b-8da5-8228dcba7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.023614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a954-3e68-498b-8da5-8228dcba7484 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.023898 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a954-3e68-498b-8da5-8228dcba7484 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.024171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a954-3e68-498b-8da5-8228dcba7484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.025297 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a954-3e68-498b-8da5-8228dcba7484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:13.026775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a954-3e68-498b-8da5-8228dcba7484 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:13.028536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 148/302] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:13.029136 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a954-3e68-498b-8da5-8228dcba7484 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:13.104723 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177db46b-7aef-4b37-bb02-ff9ffe738b26 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:13.125062 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:13.132463 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:13.143479 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a954-3e68-498b-8da5-8228dcba7484 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:13.144366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f055db-309c-4126-b1eb-13b0689fdc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.145004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f055db-309c-4126-b1eb-13b0689fdc1f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.145278 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f055db-309c-4126-b1eb-13b0689fdc1f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.145584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f055db-309c-4126-b1eb-13b0689fdc1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.156434 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f055db-309c-4126-b1eb-13b0689fdc1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-f7f055db-309c-4126-b1eb-13b0689fdc1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:13.162103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:13.163008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:13.163799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 155/303] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:13.164452 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f055db-309c-4126-b1eb-13b0689fdc1f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:13.188750 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75e651-2e46-4405-912a-d879518176db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.189429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e651-2e46-4405-912a-d879518176db None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.189717 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e651-2e46-4405-912a-d879518176db None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.189993 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e651-2e46-4405-912a-d879518176db None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.190661 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75e651-2e46-4405-912a-d879518176db None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:13.190970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75e651-2e46-4405-912a-d879518176db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:13.192926 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75e651-2e46-4405-912a-d879518176db None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:13.207809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 149/304] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:13.207809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75e651-2e46-4405-912a-d879518176db None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:13.278299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f055db-309c-4126-b1eb-13b0689fdc1f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:13.320242 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2b575-0ca5-4848-8872-7d7c401aa789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.320865 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2b575-0ca5-4848-8872-7d7c401aa789 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.321145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2b575-0ca5-4848-8872-7d7c401aa789 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.321595 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2b575-0ca5-4848-8872-7d7c401aa789 None admin] PATH_INFO: `/v3/groups` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.322129 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2b575-0ca5-4848-8872-7d7c401aa789 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:13.323572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2b575-0ca5-4848-8872-7d7c401aa789 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:13.323669 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75e651-2e46-4405-912a-d879518176db None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:13.342533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 156/305] 10.222.0.66 () {60 vars in 1134 bytes} [Wed Sep 14 15:14:13 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:14:13.350852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2b575-0ca5-4848-8872-7d7c401aa789 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:13.364379 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.365069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.365400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.365678 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.366516 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:13.366698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:13.368210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:13.380176 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 150/306] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:13.386791 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:13.409124 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:13.412985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:13.501351 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2b575-0ca5-4848-8872-7d7c401aa789 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:13.530556 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815133d3-6909-4437-b30f-5ba4b2eedb24 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:13.545606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7dc6-438f-4068-9520-a4c2cc27afd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.546579 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7dc6-438f-4068-9520-a4c2cc27afd9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.547165 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7dc6-438f-4068-9520-a4c2cc27afd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.547525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7dc6-438f-4068-9520-a4c2cc27afd9 None admin] PATH_INFO: `/v3/users/3c8578ae7db44ebdad065721dcab9e16` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.563893 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7dc6-438f-4068-9520-a4c2cc27afd9 None admin] RBAC: Authorizing `identity:get_user(user_id=3c8578ae7db44ebdad065721dcab9e16)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:13.565960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7dc6-438f-4068-9520-a4c2cc27afd9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:13.567647 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 157/307] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:13 2022] GET /identity/v3/users/3c8578ae7db44ebdad065721dcab9e16 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:13.568827 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964a4e-020b-445a-a123-91ea05313d6a None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.569111 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964a4e-020b-445a-a123-91ea05313d6a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.569421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964a4e-020b-445a-a123-91ea05313d6a None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.570624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 158/308] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:13.573305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34964a4e-020b-445a-a123-91ea05313d6a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:13.580792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850841d7-e289-4fff-bc08-bafe41dd8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.581475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850841d7-e289-4fff-bc08-bafe41dd8301 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.581822 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850841d7-e289-4fff-bc08-bafe41dd8301 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.582096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850841d7-e289-4fff-bc08-bafe41dd8301 None admin] PATH_INFO: `/v3/users/ec276a15c1be400c943f0130ecfbba82` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.583671 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850841d7-e289-4fff-bc08-bafe41dd8301 None admin] RBAC: Authorizing `identity:get_user(user_id=ec276a15c1be400c943f0130ecfbba82)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:13.585141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850841d7-e289-4fff-bc08-bafe41dd8301 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:13.587496 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 151/309] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:13 2022] GET /identity/v3/users/ec276a15c1be400c943f0130ecfbba82 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:13.589048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb84d14-fc2d-4752-9ece-b92cec087d71 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.589407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb84d14-fc2d-4752-9ece-b92cec087d71 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.589686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb84d14-fc2d-4752-9ece-b92cec087d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.610418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3eb84d14-fc2d-4752-9ece-b92cec087d71 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:13.611655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3eb84d14-fc2d-4752-9ece-b92cec087d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:13.681430 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:13.688713 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34964a4e-020b-445a-a123-91ea05313d6a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:13.696335 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 152/310] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:13.697168 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb84d14-fc2d-4752-9ece-b92cec087d71 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:13.720339 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:13.734937 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.736292 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.737004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.737531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.739074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] RBAC: Adding query filter params (role.id=a5724809c9964c4c9811dc88d60e3981, user.id=3c8578ae7db44ebdad065721dcab9e16, scope.system=all) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:13.739844 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:13.741533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:13.748491 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 159/311] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Sep 14 15:14:13 2022] GET /identity/v3/role_assignments?user.id=3c8578ae7db44ebdad065721dcab9e16&scope.system=all&role.id=a5724809c9964c4c9811dc88d60e3981 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:13.823108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb84d14-fc2d-4752-9ece-b92cec087d71 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:13.863415 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab9650-33b2-4ab4-8d88-99587ba1c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:13.864085 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab9650-33b2-4ab4-8d88-99587ba1c1fa None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:13.864358 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab9650-33b2-4ab4-8d88-99587ba1c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:13.864628 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab9650-33b2-4ab4-8d88-99587ba1c1fa None admin] PATH_INFO: `/v3/system/users/ec276a15c1be400c943f0130ecfbba82/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:13.866110 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab9650-33b2-4ab4-8d88-99587ba1c1fa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec276a15c1be400c943f0130ecfbba82, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:13.867510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab9650-33b2-4ab4-8d88-99587ba1c1fa None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:13.880062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 153/312] 10.222.0.66 () {58 vars in 1334 bytes} [Wed Sep 14 15:14:13 2022] PUT /identity/v3/system/users/ec276a15c1be400c943f0130ecfbba82/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:14.031042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:14.144395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ed98-cba1-495f-b0c4-0949af459d0e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:14.187585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef8b9f-52fd-4d57-ac2c-1cfd3a8836d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:14.188691 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8b9f-52fd-4d57-ac2c-1cfd3a8836d3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:14.189186 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8b9f-52fd-4d57-ac2c-1cfd3a8836d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:14.190233 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8b9f-52fd-4d57-ac2c-1cfd3a8836d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:14.202000 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef8b9f-52fd-4d57-ac2c-1cfd3a8836d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-07ef8b9f-52fd-4d57-ac2c-1cfd3a8836d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:14.207425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:14.208310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:14.209112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:14.211751 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 160/313] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:14.217351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab9650-33b2-4ab4-8d88-99587ba1c1fa None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:14.304119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:14.326822 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab9650-33b2-4ab4-8d88-99587ba1c1fa None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:14.363703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:14.364320 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:14.364601 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:14.364870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:14.365787 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:14.366092 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:14.367459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:14.379645 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 154/314] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:14.386691 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef8b9f-52fd-4d57-ac2c-1cfd3a8836d3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:14.417664 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:14.502488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef8b9f-52fd-4d57-ac2c-1cfd3a8836d3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:14.542584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558a12a-372a-470d-89b2-169840e78897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:14.543652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a12a-372a-470d-89b2-169840e78897 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:14.544146 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a12a-372a-470d-89b2-169840e78897 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:14.544625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a12a-372a-470d-89b2-169840e78897 None admin] PATH_INFO: `/v3/users/9d63b01176bc4df6906fd5f812d7b50c` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:14.546134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558a12a-372a-470d-89b2-169840e78897 None admin] RBAC: Authorizing `identity:get_user(user_id=9d63b01176bc4df6906fd5f812d7b50c)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:14.548152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558a12a-372a-470d-89b2-169840e78897 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:14.550896 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 161/315] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:14 2022] GET /identity/v3/users/9d63b01176bc4df6906fd5f812d7b50c => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:14.558484 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:14.666188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e986815-4479-4e2b-b9d3-9adce59c098d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:14.715431 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fddf0-64bc-4b93-b4ce-f83ffdbdaf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:14.716338 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fddf0-64bc-4b93-b4ce-f83ffdbdaf2f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:14.716769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fddf0-64bc-4b93-b4ce-f83ffdbdaf2f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:14.717189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fddf0-64bc-4b93-b4ce-f83ffdbdaf2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:14.733992 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:14.798208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fddf0-64bc-4b93-b4ce-f83ffdbdaf2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:14.799728 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fddf0-64bc-4b93-b4ce-f83ffdbdaf2f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:14.905141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 155/316] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:14.911404 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558a12a-372a-470d-89b2-169840e78897 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:15.005144 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:15.022474 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558a12a-372a-470d-89b2-169840e78897 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:15.056779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324ee86-3e80-4bd2-8e5f-1d849a426813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:15.057441 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324ee86-3e80-4bd2-8e5f-1d849a426813 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:15.057723 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324ee86-3e80-4bd2-8e5f-1d849a426813 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:15.057992 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324ee86-3e80-4bd2-8e5f-1d849a426813 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:15.059096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324ee86-3e80-4bd2-8e5f-1d849a426813 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:15.060533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324ee86-3e80-4bd2-8e5f-1d849a426813 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:15.062358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 162/317] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:14 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:15.070427 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fddf0-64bc-4b93-b4ce-f83ffdbdaf2f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:15.114598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:15.177040 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fddf0-64bc-4b93-b4ce-f83ffdbdaf2f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:15.212799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33c56e-1cc2-4b13-bf58-9098783657fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:15.213808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33c56e-1cc2-4b13-bf58-9098783657fb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:15.214348 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33c56e-1cc2-4b13-bf58-9098783657fb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:15.214854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33c56e-1cc2-4b13-bf58-9098783657fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:15.215775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33c56e-1cc2-4b13-bf58-9098783657fb None admin] RBAC: Adding query filter params (role.id=a5724809c9964c4c9811dc88d60e3981, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55, user.id=9d63b01176bc4df6906fd5f812d7b50c) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:15.216285 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33c56e-1cc2-4b13-bf58-9098783657fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:15.217963 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33c56e-1cc2-4b13-bf58-9098783657fb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:15.227420 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 156/318] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:15 2022] GET /identity/v3/role_assignments?user.id=9d63b01176bc4df6906fd5f812d7b50c&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=a5724809c9964c4c9811dc88d60e3981 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:15.888568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4672-c8cb-4d31-83df-c437d321ff64 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:15.889120 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4672-c8cb-4d31-83df-c437d321ff64 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:15.889120 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4672-c8cb-4d31-83df-c437d321ff64 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:15.890612 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 163/319] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:15.897122 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa19802-9ae1-4f7d-bf01-1f565504d453 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:15.897635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa19802-9ae1-4f7d-bf01-1f565504d453 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:15.897725 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa19802-9ae1-4f7d-bf01-1f565504d453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:15.915599 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9fa19802-9ae1-4f7d-bf01-1f565504d453 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:15.916801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9fa19802-9ae1-4f7d-bf01-1f565504d453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:15.983701 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 157/320] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:16.303282 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa19802-9ae1-4f7d-bf01-1f565504d453 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:16.303465 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63768f11-b8a7-4d9c-a46c-6fb130f5eeaa None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:16.303732 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63768f11-b8a7-4d9c-a46c-6fb130f5eeaa None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:16.303913 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63768f11-b8a7-4d9c-a46c-6fb130f5eeaa None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:16.305196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 164/321] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:16.310201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75199ae6-e9bf-43b3-a77a-bceffa92b49d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:16.310488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75199ae6-e9bf-43b3-a77a-bceffa92b49d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:16.310764 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75199ae6-e9bf-43b3-a77a-bceffa92b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:16.329667 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-75199ae6-e9bf-43b3-a77a-bceffa92b49d None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:16.330887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-75199ae6-e9bf-43b3-a77a-bceffa92b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:16.341206 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:16.402005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 165/322] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:16.410159 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa19802-9ae1-4f7d-bf01-1f565504d453 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:16.444965 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa6af8-6996-446a-a62b-d53c3b6832d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:16.445626 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6af8-6996-446a-a62b-d53c3b6832d6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:16.445903 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6af8-6996-446a-a62b-d53c3b6832d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:16.446171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6af8-6996-446a-a62b-d53c3b6832d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:16.447272 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa6af8-6996-446a-a62b-d53c3b6832d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:16.448705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa6af8-6996-446a-a62b-d53c3b6832d6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:16.450282 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 158/323] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:16.455822 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75199ae6-e9bf-43b3-a77a-bceffa92b49d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:16.496430 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837963a4-65f5-4120-8d6a-b8a623039e86 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:16.496809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837963a4-65f5-4120-8d6a-b8a623039e86 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:16.497153 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837963a4-65f5-4120-8d6a-b8a623039e86 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:16.498597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 159/324] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:16.504429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76119c2a-c41a-423d-8d41-f98ec5b87a96 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:16.504706 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76119c2a-c41a-423d-8d41-f98ec5b87a96 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:16.504977 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76119c2a-c41a-423d-8d41-f98ec5b87a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:16.526523 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-76119c2a-c41a-423d-8d41-f98ec5b87a96 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:16.527808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-76119c2a-c41a-423d-8d41-f98ec5b87a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:16.547661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:16.563733 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75199ae6-e9bf-43b3-a77a-bceffa92b49d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:16.603097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d88de-be9b-4fa3-9c83-5834088f012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:16.603705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d88de-be9b-4fa3-9c83-5834088f012b None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:16.603983 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d88de-be9b-4fa3-9c83-5834088f012b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:16.604259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d88de-be9b-4fa3-9c83-5834088f012b None admin] PATH_INFO: `/v3/groups` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:16.604878 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d88de-be9b-4fa3-9c83-5834088f012b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:16.606350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d88de-be9b-4fa3-9c83-5834088f012b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:16.612794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 160/325] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:16.623692 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 166/326] 10.222.0.66 () {60 vars in 1134 bytes} [Wed Sep 14 15:14:16 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:14:16.726946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76119c2a-c41a-423d-8d41-f98ec5b87a96 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:16.760215 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:16.834794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76119c2a-c41a-423d-8d41-f98ec5b87a96 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:16.872665 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07676a-1dce-44db-a33e-4ad7527cee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:16.873825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07676a-1dce-44db-a33e-4ad7527cee1b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:16.874109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07676a-1dce-44db-a33e-4ad7527cee1b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:16.874382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07676a-1dce-44db-a33e-4ad7527cee1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:16.886159 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07676a-1dce-44db-a33e-4ad7527cee1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-fb07676a-1dce-44db-a33e-4ad7527cee1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:16.891086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:16.892005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:16.893539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 161/327] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:16.899396 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d88de-be9b-4fa3-9c83-5834088f012b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:16.938048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07676a-1dce-44db-a33e-4ad7527cee1b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:17.021211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d88de-be9b-4fa3-9c83-5834088f012b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:17.054493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:17.059224 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:17.059831 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:17.060118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:17.060382 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:17.061050 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:17.062282 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:17.062811 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:17.067072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07676a-1dce-44db-a33e-4ad7527cee1b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:17.075775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 167/328] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:17.081432 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:17.098041 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:17.111982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98438d7-d4e2-4d7f-a628-e4b063c2219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:17.112614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98438d7-d4e2-4d7f-a628-e4b063c2219c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:17.112887 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98438d7-d4e2-4d7f-a628-e4b063c2219c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:17.113150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98438d7-d4e2-4d7f-a628-e4b063c2219c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:17.128831 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98438d7-d4e2-4d7f-a628-e4b063c2219c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f98438d7-d4e2-4d7f-a628-e4b063c2219c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:17.135697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:17.136609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:17.137491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:17.139718 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 162/329] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:14:17.144034 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98438d7-d4e2-4d7f-a628-e4b063c2219c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:17.219134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d5bc5-8f57-4892-9cd6-3132c5c812b8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:17.265564 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80194f-34fe-4b04-808e-e424d9da258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:17.266525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80194f-34fe-4b04-808e-e424d9da258c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:17.267011 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80194f-34fe-4b04-808e-e424d9da258c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:17.267363 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98438d7-d4e2-4d7f-a628-e4b063c2219c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:17.267770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80194f-34fe-4b04-808e-e424d9da258c None admin] PATH_INFO: `/v3/users/3c8578ae7db44ebdad065721dcab9e16` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:17.269562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80194f-34fe-4b04-808e-e424d9da258c None admin] RBAC: Authorizing `identity:get_user(user_id=3c8578ae7db44ebdad065721dcab9e16)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:17.272407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80194f-34fe-4b04-808e-e424d9da258c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:17.274574 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 168/330] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:17 2022] GET /identity/v3/users/3c8578ae7db44ebdad065721dcab9e16 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:17.279829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80194f-34fe-4b04-808e-e424d9da258c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:17.320310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:17.320540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:17.320814 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:17.321089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:17.321790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:17.322089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:17.323511 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:17.341468 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 163/331] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:17.342334 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:17.363024 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:17.390996 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:17.426547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80194f-34fe-4b04-808e-e424d9da258c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:17.474708 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1fd0-6ab7-4b65-9c6e-251cd3366aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:17.475691 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1fd0-6ab7-4b65-9c6e-251cd3366aa9 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:17.475819 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1fd0-6ab7-4b65-9c6e-251cd3366aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:17.476056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1fd0-6ab7-4b65-9c6e-251cd3366aa9 None admin] PATH_INFO: `/v3/system/users/3c8578ae7db44ebdad065721dcab9e16/roles/a5724809c9964c4c9811dc88d60e3981` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:17.479305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1fd0-6ab7-4b65-9c6e-251cd3366aa9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3c8578ae7db44ebdad065721dcab9e16, role_id=a5724809c9964c4c9811dc88d60e3981)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:17.480699 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1fd0-6ab7-4b65-9c6e-251cd3366aa9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:17.484133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d8a7-1558-4eea-9ad1-3430aee76fe2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:17.493333 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 169/332] 10.222.0.66 () {58 vars in 1334 bytes} [Wed Sep 14 15:14:17 2022] PUT /identity/v3/system/users/3c8578ae7db44ebdad065721dcab9e16/roles/a5724809c9964c4c9811dc88d60e3981 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:17.528153 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fda37-bb44-494f-a2fb-94a1982c3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:17.528915 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fda37-bb44-494f-a2fb-94a1982c3645 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:17.529247 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fda37-bb44-494f-a2fb-94a1982c3645 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:17.529565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fda37-bb44-494f-a2fb-94a1982c3645 None admin] PATH_INFO: `/v3/users/ec276a15c1be400c943f0130ecfbba82` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:17.531156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fda37-bb44-494f-a2fb-94a1982c3645 None admin] RBAC: Authorizing `identity:get_user(user_id=ec276a15c1be400c943f0130ecfbba82)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:17.532849 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fda37-bb44-494f-a2fb-94a1982c3645 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:17.535220 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 164/333] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:17 2022] GET /identity/v3/users/ec276a15c1be400c943f0130ecfbba82 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:17.541480 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1fd0-6ab7-4b65-9c6e-251cd3366aa9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:17.666207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1fd0-6ab7-4b65-9c6e-251cd3366aa9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:17.709104 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773e834-cce2-4452-87ca-dbf5951c3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:17.709764 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e834-cce2-4452-87ca-dbf5951c3727 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:17.710045 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e834-cce2-4452-87ca-dbf5951c3727 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:17.710329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e834-cce2-4452-87ca-dbf5951c3727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:17.711068 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773e834-cce2-4452-87ca-dbf5951c3727 None admin] RBAC: Adding query filter params (role.id=640205c745f84440b40441060cf8c9b4, user.id=ec276a15c1be400c943f0130ecfbba82, scope.system=all) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:17.711379 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773e834-cce2-4452-87ca-dbf5951c3727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:17.712866 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773e834-cce2-4452-87ca-dbf5951c3727 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:17.721856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:17.730707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 170/334] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Sep 14 15:14:17 2022] GET /identity/v3/role_assignments?user.id=ec276a15c1be400c943f0130ecfbba82&scope.system=all&role.id=640205c745f84440b40441060cf8c9b4 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:19.827368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f126-7104-4da1-88f7-5cdbfb706001 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:19.827921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f126-7104-4da1-88f7-5cdbfb706001 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:19.827921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f126-7104-4da1-88f7-5cdbfb706001 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:19.829551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 165/335] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:19.835425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fd33-f420-48d6-87ec-ffb5bfbfb1ce None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:19.835885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fd33-f420-48d6-87ec-ffb5bfbfb1ce None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:19.835969 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0fd33-f420-48d6-87ec-ffb5bfbfb1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:19.862593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f1e0fd33-f420-48d6-87ec-ffb5bfbfb1ce None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:19.863811 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f1e0fd33-f420-48d6-87ec-ffb5bfbfb1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:19.942325 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 171/336] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:20.022522 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7e42-dc57-4774-ac89-f295fa9059c9 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:20.022841 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7e42-dc57-4774-ac89-f295fa9059c9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:20.023079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7e42-dc57-4774-ac89-f295fa9059c9 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:20.024681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 166/337] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:20.029954 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8264e1-5625-49c9-8eb7-0cfe098eef70 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:20.030243 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8264e1-5625-49c9-8eb7-0cfe098eef70 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:20.030521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8264e1-5625-49c9-8eb7-0cfe098eef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:20.053738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4d8264e1-5625-49c9-8eb7-0cfe098eef70 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:20.054935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4d8264e1-5625-49c9-8eb7-0cfe098eef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:20.142692 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 172/338] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:20.195092 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5ab9-ad72-4c01-9a31-1dfb1105edbf None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:20.195400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5ab9-ad72-4c01-9a31-1dfb1105edbf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:20.195641 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5ab9-ad72-4c01-9a31-1dfb1105edbf None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:20.197416 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 167/339] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:20.202769 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166f9d-8ba9-4b55-8fa2-b7b50a8b28d2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:20.203065 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166f9d-8ba9-4b55-8fa2-b7b50a8b28d2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:20.203347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166f9d-8ba9-4b55-8fa2-b7b50a8b28d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:20.230331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-54166f9d-8ba9-4b55-8fa2-b7b50a8b28d2 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:20.231526 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-54166f9d-8ba9-4b55-8fa2-b7b50a8b28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:20.292325 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:20.309930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 173/340] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:20.565961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df5ab9-ad72-4c01-9a31-1dfb1105edbf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:20.652325 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54166f9d-8ba9-4b55-8fa2-b7b50a8b28d2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:20.670499 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:20.698900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df5ab9-ad72-4c01-9a31-1dfb1105edbf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:20.749114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2ebd-dc7d-4c00-a5d3-ef9a57110b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:20.749796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2ebd-dc7d-4c00-a5d3-ef9a57110b62 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:20.750330 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2ebd-dc7d-4c00-a5d3-ef9a57110b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:20.750774 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2ebd-dc7d-4c00-a5d3-ef9a57110b62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:20.768035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d2ebd-dc7d-4c00-a5d3-ef9a57110b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-3e6d2ebd-dc7d-4c00-a5d3-ef9a57110b62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:20.773413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:20.774497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:20.775475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:20.781689 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 168/341] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:14:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:20.786298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2ebd-dc7d-4c00-a5d3-ef9a57110b62 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:20.885604 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54166f9d-8ba9-4b55-8fa2-b7b50a8b28d2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:20.921886 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2ebd-dc7d-4c00-a5d3-ef9a57110b62 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:20.947070 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a801de0-7979-4a00-8c20-7d4240a367f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:20.947955 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801de0-7979-4a00-8c20-7d4240a367f5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:20.949183 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801de0-7979-4a00-8c20-7d4240a367f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:20.949870 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801de0-7979-4a00-8c20-7d4240a367f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:20.974401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a801de0-7979-4a00-8c20-7d4240a367f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-8a801de0-7979-4a00-8c20-7d4240a367f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:20.980067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:20.980979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 174/342] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:20.984525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a801de0-7979-4a00-8c20-7d4240a367f5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:20.992280 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:20.993150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:20.993635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:20.994087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:20.994927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:20.995421 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:20.996987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:21.007218 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 169/343] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:21.014484 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:21.019907 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:21.067884 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:21.133785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a801de0-7979-4a00-8c20-7d4240a367f5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:21.204075 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb31f4-8ba0-4a5e-93aa-15c3d652a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:21.204495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5307-71b9-4273-b629-4a6568de8a0c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:21.204677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb31f4-8ba0-4a5e-93aa-15c3d652a084 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:21.207135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb31f4-8ba0-4a5e-93aa-15c3d652a084 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:21.207429 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb31f4-8ba0-4a5e-93aa-15c3d652a084 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:21.232527 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb31f4-8ba0-4a5e-93aa-15c3d652a084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e7cb31f4-8ba0-4a5e-93aa-15c3d652a084 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:21.238873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:21.239848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:21.240669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 175/344] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:21.241495 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb31f4-8ba0-4a5e-93aa-15c3d652a084 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:21.265733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d602-6ab2-47c5-892a-7a170333f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:21.266719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d602-6ab2-47c5-892a-7a170333f36e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:21.267232 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d602-6ab2-47c5-892a-7a170333f36e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:21.270982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d602-6ab2-47c5-892a-7a170333f36e None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:21.270982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665d602-6ab2-47c5-892a-7a170333f36e None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:21.270982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665d602-6ab2-47c5-892a-7a170333f36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:21.271842 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665d602-6ab2-47c5-892a-7a170333f36e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:21.283504 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 170/345] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:21.285138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a680fd-a152-446e-986d-853a1182fde2 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:21.285566 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a680fd-a152-446e-986d-853a1182fde2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:21.285845 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a680fd-a152-446e-986d-853a1182fde2 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:21.287351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 171/346] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:21.288228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a680fd-a152-446e-986d-853a1182fde2 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:21.369487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:21.400930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb31f4-8ba0-4a5e-93aa-15c3d652a084 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:21.410590 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a680fd-a152-446e-986d-853a1182fde2 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:21.417128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:21.448944 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1435da3-4f2e-4b02-b7c4-f91c7f5bb0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:21.450220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1435da3-4f2e-4b02-b7c4-f91c7f5bb0f1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:21.450827 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1435da3-4f2e-4b02-b7c4-f91c7f5bb0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:21.451307 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1435da3-4f2e-4b02-b7c4-f91c7f5bb0f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:21.452270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:21.452879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:21.453154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:21.453450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:21.454166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:21.454405 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:21.455939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:21.465407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 172/347] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:21.466442 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:21.538901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1435da3-4f2e-4b02-b7c4-f91c7f5bb0f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:21.538901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1435da3-4f2e-4b02-b7c4-f91c7f5bb0f1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:21.581006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb4a62-f016-4151-a419-71033127a736 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:21.612997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:21.623323 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510b01e-0fa0-4694-8db5-dddc331527f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:21.623934 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510b01e-0fa0-4694-8db5-dddc331527f3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:21.624476 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510b01e-0fa0-4694-8db5-dddc331527f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:21.624759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510b01e-0fa0-4694-8db5-dddc331527f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:21.664274 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 176/348] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:21.665711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478d933-0976-41ba-8855-3e31a1e81d23 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:21.666006 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478d933-0976-41ba-8855-3e31a1e81d23 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:21.666279 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478d933-0976-41ba-8855-3e31a1e81d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:21.688922 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b478d933-0976-41ba-8855-3e31a1e81d23 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:21.691038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b478d933-0976-41ba-8855-3e31a1e81d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:21.695116 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:21.714103 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510b01e-0fa0-4694-8db5-dddc331527f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:21.715481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510b01e-0fa0-4694-8db5-dddc331527f3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:21.782617 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 177/349] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:21.784514 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478d933-0976-41ba-8855-3e31a1e81d23 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:21.827607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 173/350] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:21.828462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510b01e-0fa0-4694-8db5-dddc331527f3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:21.862006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:21.901074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478d933-0976-41ba-8855-3e31a1e81d23 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:21.945263 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6aa8-03ad-46fa-9075-7d9e3e6be801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:21.946372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6aa8-03ad-46fa-9075-7d9e3e6be801 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:21.946856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6aa8-03ad-46fa-9075-7d9e3e6be801 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:21.947230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6aa8-03ad-46fa-9075-7d9e3e6be801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:21.949001 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510b01e-0fa0-4694-8db5-dddc331527f3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:21.958948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:21.999332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdd25-3cbb-4fa0-85bc-ab213567d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.000208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdd25-3cbb-4fa0-85bc-ab213567d5cf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.000640 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdd25-3cbb-4fa0-85bc-ab213567d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.001340 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdd25-3cbb-4fa0-85bc-ab213567d5cf None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.003872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdd25-3cbb-4fa0-85bc-ab213567d5cf None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.005833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdd25-3cbb-4fa0-85bc-ab213567d5cf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.008357 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 174/351] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:21 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:22.010301 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522069d4-128f-45dd-8ead-99cf32e87ddb None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.010742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522069d4-128f-45dd-8ead-99cf32e87ddb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.011332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522069d4-128f-45dd-8ead-99cf32e87ddb None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.013458 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 175/352] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:22.014794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522069d4-128f-45dd-8ead-99cf32e87ddb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.028965 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f6aa8-03ad-46fa-9075-7d9e3e6be801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.031879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f6aa8-03ad-46fa-9075-7d9e3e6be801 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.145785 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:22.153938 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 178/353] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:22.156666 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522069d4-128f-45dd-8ead-99cf32e87ddb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:22.157379 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6aa8-03ad-46fa-9075-7d9e3e6be801 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.207411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadc58-9aa0-4179-be6e-b8f861068dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.208042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadc58-9aa0-4179-be6e-b8f861068dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.208318 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadc58-9aa0-4179-be6e-b8f861068dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.208589 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadc58-9aa0-4179-be6e-b8f861068dd8 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.209744 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aadc58-9aa0-4179-be6e-b8f861068dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.211177 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aadc58-9aa0-4179-be6e-b8f861068dd8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.212278 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:22.214071 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 176/354] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:22.215426 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997dc6-2d26-4c04-9b80-a1335733d0fe None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.215789 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997dc6-2d26-4c04-9b80-a1335733d0fe None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.216542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997dc6-2d26-4c04-9b80-a1335733d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.241218 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-91997dc6-2d26-4c04-9b80-a1335733d0fe None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:22.241861 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-91997dc6-2d26-4c04-9b80-a1335733d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:22.314687 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6aa8-03ad-46fa-9075-7d9e3e6be801 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:22.346944 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 177/355] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:22.347854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91997dc6-2d26-4c04-9b80-a1335733d0fe None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.363687 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2074d79-3dce-41f2-a35b-8f387252b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.364646 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074d79-3dce-41f2-a35b-8f387252b553 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.365103 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074d79-3dce-41f2-a35b-8f387252b553 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.365694 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074d79-3dce-41f2-a35b-8f387252b553 None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.375136 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2074d79-3dce-41f2-a35b-8f387252b553 None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.377003 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2074d79-3dce-41f2-a35b-8f387252b553 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.383893 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 179/356] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:22.384913 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2074d79-3dce-41f2-a35b-8f387252b553 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.460063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:22.470506 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91997dc6-2d26-4c04-9b80-a1335733d0fe None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:22.511525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2074d79-3dce-41f2-a35b-8f387252b553 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:22.513798 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:22.528207 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975410-7300-4bff-ab32-408a83a49278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.528842 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975410-7300-4bff-ab32-408a83a49278 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.529116 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975410-7300-4bff-ab32-408a83a49278 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.529415 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975410-7300-4bff-ab32-408a83a49278 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.530543 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e975410-7300-4bff-ab32-408a83a49278 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.531978 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e975410-7300-4bff-ab32-408a83a49278 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.533663 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 178/357] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:22.534552 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975410-7300-4bff-ab32-408a83a49278 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.560241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4ed4-9603-4d46-8416-a7d41044acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.561886 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4ed4-9603-4d46-8416-a7d41044acdf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.562394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4ed4-9603-4d46-8416-a7d41044acdf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.563120 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4ed4-9603-4d46-8416-a7d41044acdf None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.565272 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4ed4-9603-4d46-8416-a7d41044acdf None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.567871 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4ed4-9603-4d46-8416-a7d41044acdf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.570437 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 180/358] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:22.571737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4ed4-9603-4d46-8416-a7d41044acdf None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.665509 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975410-7300-4bff-ab32-408a83a49278 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:22.709951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ca60-05ec-45d6-a962-02787f37399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.710617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ca60-05ec-45d6-a962-02787f37399a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.710895 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ca60-05ec-45d6-a962-02787f37399a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.711162 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ca60-05ec-45d6-a962-02787f37399a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.720151 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4ed4-9603-4d46-8416-a7d41044acdf None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:22.726632 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705ca60-05ec-45d6-a962-02787f37399a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b705ca60-05ec-45d6-a962-02787f37399a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:22.731667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:22.732560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:22.733381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 179/359] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:22.735917 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ca60-05ec-45d6-a962-02787f37399a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.764820 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:22.770862 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.771482 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.771759 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.772027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.772786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] RBAC: Adding query filter params (group.id=4a01ffa88e2e49109c523c0cf210c61e, role.id=a0aef3a60f6e4b7494f8707e8621dece, scope.project.id=787ddddee610423b947680623cefeb72) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:22.773092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.775116 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.781622 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 181/360] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/role_assignments?group.id=4a01ffa88e2e49109c523c0cf210c61e&scope.project.id=787ddddee610423b947680623cefeb72&role.id=a0aef3a60f6e4b7494f8707e8621dece => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:22.782218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.832597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:22.877975 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ca60-05ec-45d6-a962-02787f37399a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:22.923285 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c79a3-cd98-469f-8dcd-243f8ba51d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.924469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c79a3-cd98-469f-8dcd-243f8ba51d5b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.924753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c79a3-cd98-469f-8dcd-243f8ba51d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.925028 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c79a3-cd98-469f-8dcd-243f8ba51d5b None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.926533 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c79a3-cd98-469f-8dcd-243f8ba51d5b None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.928035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c79a3-cd98-469f-8dcd-243f8ba51d5b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.929378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc068a7-aa05-479a-bca0-bb1aa8bad56e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:22.929824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 180/361] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:22.930495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c79a3-cd98-469f-8dcd-243f8ba51d5b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:22.981806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24819d91-8e5a-4ea8-8b45-583ce0e43fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:22.982746 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819d91-8e5a-4ea8-8b45-583ce0e43fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.983238 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819d91-8e5a-4ea8-8b45-583ce0e43fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.983694 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819d91-8e5a-4ea8-8b45-583ce0e43fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:22.984623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24819d91-8e5a-4ea8-8b45-583ce0e43fc8 None admin] RBAC: Adding query filter params (group.id=4a01ffa88e2e49109c523c0cf210c61e, role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=787ddddee610423b947680623cefeb72) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:22.985139 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24819d91-8e5a-4ea8-8b45-583ce0e43fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:22.987339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24819d91-8e5a-4ea8-8b45-583ce0e43fc8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:22.994949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 182/362] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/role_assignments?group.id=4a01ffa88e2e49109c523c0cf210c61e&scope.project.id=787ddddee610423b947680623cefeb72&role.id=640205c745f84440b40441060cf8c9b4 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:22.996494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7928bb-a0fe-49a8-9112-d992ddc8d5b8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:22.996976 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7928bb-a0fe-49a8-9112-d992ddc8d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:22.997258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7928bb-a0fe-49a8-9112-d992ddc8d5b8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.001013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 183/363] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:23.010258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7928bb-a0fe-49a8-9112-d992ddc8d5b8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:23.070945 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:23.084493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c79a3-cd98-469f-8dcd-243f8ba51d5b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:23.130173 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:23.130907 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:23.131196 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:23.131469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.132156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:23.132460 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:23.134041 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:23.144745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 181/364] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:23.145761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:23.146716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:23.153391 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7928bb-a0fe-49a8-9112-d992ddc8d5b8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:23.196171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df014-763c-4bb1-9875-07e38446bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:23.196828 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df014-763c-4bb1-9875-07e38446bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:23.197105 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df014-763c-4bb1-9875-07e38446bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:23.197410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df014-763c-4bb1-9875-07e38446bdd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.210092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84df014-763c-4bb1-9875-07e38446bdd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e84df014-763c-4bb1-9875-07e38446bdd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:23.215442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:23.216399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:23.217205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 184/365] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:14:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:23.218412 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aba4c-a011-4e1c-8139-5dd3a7eed7fe None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:23.220137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aba4c-a011-4e1c-8139-5dd3a7eed7fe None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:23.220137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aba4c-a011-4e1c-8139-5dd3a7eed7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.240237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ff1aba4c-a011-4e1c-8139-5dd3a7eed7fe None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:23.241519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ff1aba4c-a011-4e1c-8139-5dd3a7eed7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:23.282171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be752-437e-407b-b3f2-2012d0314e68 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:23.327840 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:23.328806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:23.329234 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:23.329830 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.330720 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] RBAC: Adding query filter params (group.id=4a01ffa88e2e49109c523c0cf210c61e, role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:23.331178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:23.333034 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:23.338380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 185/366] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:23.339253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aba4c-a011-4e1c-8139-5dd3a7eed7fe None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:23.339674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 182/367] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:23 2022] GET /identity/v3/role_assignments?group.id=4a01ffa88e2e49109c523c0cf210c61e&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=640205c745f84440b40441060cf8c9b4 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:23.340612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:23.371985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:23.471632 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6347f-0653-4ed6-8d0a-48d052ae74e8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:23.515219 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:23.515848 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:23.516131 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:23.516408 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.517079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:23.517453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:23.518848 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:23.544443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 183/368] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:23.558367 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:23.561721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:23.596251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aba4c-a011-4e1c-8139-5dd3a7eed7fe None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:23.670397 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89964077-b69e-47d8-8435-d05b2d9d3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:23.672807 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964077-b69e-47d8-8435-d05b2d9d3937 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:23.673297 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964077-b69e-47d8-8435-d05b2d9d3937 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:23.674721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964077-b69e-47d8-8435-d05b2d9d3937 None admin] PATH_INFO: `/v3/users/3c8578ae7db44ebdad065721dcab9e16` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.676734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89964077-b69e-47d8-8435-d05b2d9d3937 None admin] RBAC: Authorizing `identity:get_user(user_id=3c8578ae7db44ebdad065721dcab9e16)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:23.682045 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89964077-b69e-47d8-8435-d05b2d9d3937 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:23.683919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 186/369] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Sep 14 15:14:23 2022] GET /identity/v3/users/3c8578ae7db44ebdad065721dcab9e16 => generated 293 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:23.690005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89964077-b69e-47d8-8435-d05b2d9d3937 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:23.749072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:23.786009 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be3024-e86f-47ab-b0df-7fd0e3fcbef1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:23.825229 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8b375-63c9-454c-854f-c6c9302947a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:23.826118 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8b375-63c9-454c-854f-c6c9302947a6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:23.826540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8b375-63c9-454c-854f-c6c9302947a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:23.830457 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8b375-63c9-454c-854f-c6c9302947a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.835796 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89964077-b69e-47d8-8435-d05b2d9d3937 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:23.887885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:23.888846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:23.889940 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:23.890612 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:23.892269 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] RBAC: Adding query filter params (role.id=a5724809c9964c4c9811dc88d60e3981, user.id=3c8578ae7db44ebdad065721dcab9e16, scope.system=all) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:23.894092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:23.896357 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:23.927610 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8b375-63c9-454c-854f-c6c9302947a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:23.928041 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 187/370] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Sep 14 15:14:23 2022] GET /identity/v3/role_assignments?user.id=3c8578ae7db44ebdad065721dcab9e16&scope.system=all&role.id=a5724809c9964c4c9811dc88d60e3981 => generated 510 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:23.928703 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:23.929089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8b375-63c9-454c-854f-c6c9302947a6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:23.972770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:24.044050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:24.074459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 184/371] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:14:24.080231 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8b375-63c9-454c-854f-c6c9302947a6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:24.229489 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8b375-63c9-454c-854f-c6c9302947a6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:24.259668 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3fbeb-2300-462b-86f4-360e64d44031 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:24.281854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0933763-3a58-42c6-8505-7a7ffd4b0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:24.282503 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0933763-3a58-42c6-8505-7a7ffd4b0e99 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:24.282784 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0933763-3a58-42c6-8505-7a7ffd4b0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:24.283584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0933763-3a58-42c6-8505-7a7ffd4b0e99 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:24.286666 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0933763-3a58-42c6-8505-7a7ffd4b0e99 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:24.288159 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0933763-3a58-42c6-8505-7a7ffd4b0e99 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:24.291265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 185/372] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:24 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:24.298368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0933763-3a58-42c6-8505-7a7ffd4b0e99 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:24.321439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2d174-46be-40c5-ae1c-c0438a18d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:24.321439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2d174-46be-40c5-ae1c-c0438a18d38e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:24.321439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2d174-46be-40c5-ae1c-c0438a18d38e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:24.321439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2d174-46be-40c5-ae1c-c0438a18d38e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:24.334794 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2d174-46be-40c5-ae1c-c0438a18d38e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-66d2d174-46be-40c5-ae1c-c0438a18d38e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:24.340552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:24.341533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:24.342608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 188/373] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:24.350431 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2d174-46be-40c5-ae1c-c0438a18d38e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:24.410256 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:24.451237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:24.482749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2d174-46be-40c5-ae1c-c0438a18d38e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:24.523849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:24.524845 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:24.525226 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:24.525634 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:24.526684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:24.527090 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:24.529364 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:24.531010 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0933763-3a58-42c6-8505-7a7ffd4b0e99 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:24.540733 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 189/374] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:24.546603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:24.606928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22ba1-b87d-44f6-b3be-a2b982a428e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:24.607823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22ba1-b87d-44f6-b3be-a2b982a428e5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:24.608266 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22ba1-b87d-44f6-b3be-a2b982a428e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:24.608674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22ba1-b87d-44f6-b3be-a2b982a428e5 None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:24.614047 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb22ba1-b87d-44f6-b3be-a2b982a428e5 None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:24.615705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb22ba1-b87d-44f6-b3be-a2b982a428e5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:24.617568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 186/375] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:24 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:24.624143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22ba1-b87d-44f6-b3be-a2b982a428e5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:24.673556 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0a585-dc5a-4f07-b03e-3f7c526854e2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:24.719513 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd7da6-7748-4872-8396-ba9a08e63274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:24.721934 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd7da6-7748-4872-8396-ba9a08e63274 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:24.722431 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd7da6-7748-4872-8396-ba9a08e63274 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:24.722932 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd7da6-7748-4872-8396-ba9a08e63274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:24.727354 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:24.813350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd7da6-7748-4872-8396-ba9a08e63274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:24.816051 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd7da6-7748-4872-8396-ba9a08e63274 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:24.831678 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22ba1-b87d-44f6-b3be-a2b982a428e5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:24.863262 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:24.918984 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:24.919616 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:24.919884 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:24.920160 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:24.920882 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] RBAC: Adding query filter params (group.id=4a01ffa88e2e49109c523c0cf210c61e, role.id=a0aef3a60f6e4b7494f8707e8621dece, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:24.921186 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:24.922703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:24.936033 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 187/376] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:24 2022] GET /identity/v3/role_assignments?group.id=4a01ffa88e2e49109c523c0cf210c61e&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=a0aef3a60f6e4b7494f8707e8621dece => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:24.946097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 190/377] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:24.951548 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:25.100758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4161f51-44c2-446a-9e13-d6ece95c0746 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:25.151610 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f95dd-b9fc-4ceb-aabf-585d4aa4d683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:25.152262 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f95dd-b9fc-4ceb-aabf-585d4aa4d683 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:25.152542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f95dd-b9fc-4ceb-aabf-585d4aa4d683 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:25.152814 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f95dd-b9fc-4ceb-aabf-585d4aa4d683 None admin] PATH_INFO: `/v3/projects/d960b8bb994249d4bc3ba704789927ea` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:25.154007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f95dd-b9fc-4ceb-aabf-585d4aa4d683 None admin] RBAC: Authorizing `identity:get_project(project_id=d960b8bb994249d4bc3ba704789927ea)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:25.155455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f95dd-b9fc-4ceb-aabf-585d4aa4d683 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:25.157154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 188/378] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:24 2022] GET /identity/v3/projects/d960b8bb994249d4bc3ba704789927ea => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:25.163587 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd7da6-7748-4872-8396-ba9a08e63274 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:25.215034 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:25.308282 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd7da6-7748-4872-8396-ba9a08e63274 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:25.362135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b278788-39fb-4fa0-9f86-25ed3fa9d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:25.362705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278788-39fb-4fa0-9f86-25ed3fa9d89f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:25.362983 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278788-39fb-4fa0-9f86-25ed3fa9d89f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:25.363316 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278788-39fb-4fa0-9f86-25ed3fa9d89f None admin] PATH_INFO: `/v3/groups/0f2b4eb7a0b049ceb91b957140ae60c6` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:25.368933 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b278788-39fb-4fa0-9f86-25ed3fa9d89f None admin] RBAC: Authorizing `identity:get_group(group_id=0f2b4eb7a0b049ceb91b957140ae60c6)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:25.370439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b278788-39fb-4fa0-9f86-25ed3fa9d89f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:25.372063 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 191/379] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:25 2022] GET /identity/v3/groups/0f2b4eb7a0b049ceb91b957140ae60c6 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:25.377945 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f95dd-b9fc-4ceb-aabf-585d4aa4d683 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:25.449390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:25.518333 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f95dd-b9fc-4ceb-aabf-585d4aa4d683 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:25.563392 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6294337-826b-4d78-9c7c-8d5086a36425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:25.564058 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6294337-826b-4d78-9c7c-8d5086a36425 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:25.564958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6294337-826b-4d78-9c7c-8d5086a36425 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:25.565271 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6294337-826b-4d78-9c7c-8d5086a36425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:25.566068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6294337-826b-4d78-9c7c-8d5086a36425 None admin] RBAC: Adding query filter params (group.id=0f2b4eb7a0b049ceb91b957140ae60c6, role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=d960b8bb994249d4bc3ba704789927ea) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:25.566379 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6294337-826b-4d78-9c7c-8d5086a36425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:25.567822 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6294337-826b-4d78-9c7c-8d5086a36425 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:25.577427 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 189/380] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:25 2022] GET /identity/v3/role_assignments?group.id=0f2b4eb7a0b049ceb91b957140ae60c6&scope.project.id=d960b8bb994249d4bc3ba704789927ea&role.id=6211512533b744e8b1ee9031113654ac => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:26.077825 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983c922-d521-4730-a940-988dff27b1e8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:26.078196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983c922-d521-4730-a940-988dff27b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:26.078377 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983c922-d521-4730-a940-988dff27b1e8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:26.079914 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 192/381] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:26.085565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc8e05-7169-4cd4-a8a1-af6de2a54418 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:26.085859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc8e05-7169-4cd4-a8a1-af6de2a54418 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:26.086142 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc8e05-7169-4cd4-a8a1-af6de2a54418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:26.105914 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f6fc8e05-7169-4cd4-a8a1-af6de2a54418 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:26.107110 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f6fc8e05-7169-4cd4-a8a1-af6de2a54418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:26.191724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 190/382] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:26.632842 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550a98-1432-4aa1-9a5a-4cbe1a3e61d6 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:26.633439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550a98-1432-4aa1-9a5a-4cbe1a3e61d6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:26.633439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550a98-1432-4aa1-9a5a-4cbe1a3e61d6 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:26.634878 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 193/383] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:26.640060 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1648d7-6165-4ff9-a2a2-5a483392619d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:26.640598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1648d7-6165-4ff9-a2a2-5a483392619d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:26.641118 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1648d7-6165-4ff9-a2a2-5a483392619d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:26.665681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3f1648d7-6165-4ff9-a2a2-5a483392619d None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:26.667211 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3f1648d7-6165-4ff9-a2a2-5a483392619d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:26.710851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:26.752180 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 191/384] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:26.833851 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63550a98-1432-4aa1-9a5a-4cbe1a3e61d6 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:26.951678 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865975f4-ba20-442d-8edb-9c50b0ddf30a None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:26.952594 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865975f4-ba20-442d-8edb-9c50b0ddf30a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:26.953096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865975f4-ba20-442d-8edb-9c50b0ddf30a None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:26.955564 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:26.956965 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 192/385] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:26.962088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63550a98-1432-4aa1-9a5a-4cbe1a3e61d6 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:26.963291 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39042-c215-431f-b78a-af1a2dcedd13 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:26.963978 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39042-c215-431f-b78a-af1a2dcedd13 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:26.965363 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39042-c215-431f-b78a-af1a2dcedd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.003277 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6df39042-c215-431f-b78a-af1a2dcedd13 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:27.004937 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6df39042-c215-431f-b78a-af1a2dcedd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:27.032716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90527735-5a06-4c54-a1ec-62d8f9e8ae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:27.033409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90527735-5a06-4c54-a1ec-62d8f9e8ae7c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.033684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90527735-5a06-4c54-a1ec-62d8f9e8ae7c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.033949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90527735-5a06-4c54-a1ec-62d8f9e8ae7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.057949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90527735-5a06-4c54-a1ec-62d8f9e8ae7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-90527735-5a06-4c54-a1ec-62d8f9e8ae7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:27.063419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:27.064863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:27.065721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:27.068241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 194/386] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:14:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:27.071314 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90527735-5a06-4c54-a1ec-62d8f9e8ae7c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:27.101381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 193/387] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:27.218501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90527735-5a06-4c54-a1ec-62d8f9e8ae7c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:27.266159 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:27.267132 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.268164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.268642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.269568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:27.270078 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:27.271634 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39042-c215-431f-b78a-af1a2dcedd13 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:27.272347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:27.283094 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 195/388] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:27.291747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:27.339500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:27.488697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:27.492833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39042-c215-431f-b78a-af1a2dcedd13 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:27.511053 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5020417-3f9e-4da9-9c5f-0cffd157eb9f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:27.552115 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a480da9-69ef-4a05-9d31-7ad85e423fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:27.552754 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480da9-69ef-4a05-9d31-7ad85e423fe7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.553030 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480da9-69ef-4a05-9d31-7ad85e423fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.553298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480da9-69ef-4a05-9d31-7ad85e423fe7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.569157 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a480da9-69ef-4a05-9d31-7ad85e423fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4a480da9-69ef-4a05-9d31-7ad85e423fe7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:27.574332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:27.575205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:27.576044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 194/389] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:14:27.582024 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98511-391d-4997-92ac-144130f1b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:27.582682 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98511-391d-4997-92ac-144130f1b85a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.582928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a480da9-69ef-4a05-9d31-7ad85e423fe7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:27.583043 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98511-391d-4997-92ac-144130f1b85a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.583222 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98511-391d-4997-92ac-144130f1b85a None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.584366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98511-391d-4997-92ac-144130f1b85a None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:27.585848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98511-391d-4997-92ac-144130f1b85a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:27.587957 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 196/390] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:27 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:27.593857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98511-391d-4997-92ac-144130f1b85a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:27.708814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:27.713596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a480da9-69ef-4a05-9d31-7ad85e423fe7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:27.719102 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98511-391d-4997-92ac-144130f1b85a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:27.756631 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec8e9-c0f8-43bd-ba23-68d57b0188b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:27.757168 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec8e9-c0f8-43bd-ba23-68d57b0188b6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.757491 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec8e9-c0f8-43bd-ba23-68d57b0188b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.757765 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec8e9-c0f8-43bd-ba23-68d57b0188b6 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.758590 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:27.758887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feec8e9-c0f8-43bd-ba23-68d57b0188b6 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:27.759793 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.760321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.760425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feec8e9-c0f8-43bd-ba23-68d57b0188b6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:27.760881 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.761794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:27.762300 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:27.762402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 197/391] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:27 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:27.763146 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec8e9-c0f8-43bd-ba23-68d57b0188b6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:27.764258 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:27.777846 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 195/392] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:27.780269 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:27.809781 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:27.877453 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec8e9-c0f8-43bd-ba23-68d57b0188b6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:27.899193 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b654d4-b323-40e4-920f-8a5f57cd17bd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:27.917490 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f432d-f4e1-4f3a-98f6-fca930b3b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:27.918076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f432d-f4e1-4f3a-98f6-fca930b3b25b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.918360 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f432d-f4e1-4f3a-98f6-fca930b3b25b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.918618 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f432d-f4e1-4f3a-98f6-fca930b3b25b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.935494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f432d-f4e1-4f3a-98f6-fca930b3b25b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-d25f432d-f4e1-4f3a-98f6-fca930b3b25b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:27.941268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:27.942210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:27.943044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 198/393] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:27.943714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f432d-f4e1-4f3a-98f6-fca930b3b25b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:27.956150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1637b6a-d5a6-4665-a853-32772bbceecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:27.957430 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1637b6a-d5a6-4665-a853-32772bbceecc None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.957721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1637b6a-d5a6-4665-a853-32772bbceecc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.958004 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1637b6a-d5a6-4665-a853-32772bbceecc None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72/groups/4a01ffa88e2e49109c523c0cf210c61e/roles/a0aef3a60f6e4b7494f8707e8621dece` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.961716 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1637b6a-d5a6-4665-a853-32772bbceecc None admin] RBAC: Authorizing `identity:create_grant(project_id=787ddddee610423b947680623cefeb72, group_id=4a01ffa88e2e49109c523c0cf210c61e, role_id=a0aef3a60f6e4b7494f8707e8621dece)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:27.963169 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1637b6a-d5a6-4665-a853-32772bbceecc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:27.973481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:27.980481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 196/394] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Sep 14 15:14:27 2022] PUT /identity/v3/projects/787ddddee610423b947680623cefeb72/groups/4a01ffa88e2e49109c523c0cf210c61e/roles/a0aef3a60f6e4b7494f8707e8621dece => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:14:27.990855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532f1a-3a91-4eeb-80b7-7e3627e8b3d4 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:27.991165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532f1a-3a91-4eeb-80b7-7e3627e8b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:27.991422 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a532f1a-3a91-4eeb-80b7-7e3627e8b3d4 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:27.992939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 197/395] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:27.996736 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a532f1a-3a91-4eeb-80b7-7e3627e8b3d4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:28.072873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f432d-f4e1-4f3a-98f6-fca930b3b25b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:28.094862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:28.118774 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a532f1a-3a91-4eeb-80b7-7e3627e8b3d4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:28.120962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1bdd-cc86-49b3-9ab9-9c80a1237d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:28.122044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1bdd-cc86-49b3-9ab9-9c80a1237d23 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.122519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1bdd-cc86-49b3-9ab9-9c80a1237d23 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.122993 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1bdd-cc86-49b3-9ab9-9c80a1237d23 None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.124418 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c1bdd-cc86-49b3-9ab9-9c80a1237d23 None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:28.126105 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c1bdd-cc86-49b3-9ab9-9c80a1237d23 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:28.128200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 199/396] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:27 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:28.131380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9ec4-6724-4eed-9f5e-863106c89657 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.135646 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9ec4-6724-4eed-9f5e-863106c89657 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.136190 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9ec4-6724-4eed-9f5e-863106c89657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.157864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a23f9ec4-6724-4eed-9f5e-863106c89657 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:28.159571 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:28.160303 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.160415 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a23f9ec4-6724-4eed-9f5e-863106c89657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:28.160642 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.160990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.161799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:28.162191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:28.164004 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:28.176144 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 198/397] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:28.177248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:28.244255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 200/398] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:28.246055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f9ec4-6724-4eed-9f5e-863106c89657 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:28.265019 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:28.319180 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ebed1-a726-4875-ac1a-14bc637b96ba None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:28.376488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f9ec4-6724-4eed-9f5e-863106c89657 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:28.398639 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedc83-5c6e-49b3-b2d3-27d7c0b9aec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:28.399551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedc83-5c6e-49b3-b2d3-27d7c0b9aec5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.399986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedc83-5c6e-49b3-b2d3-27d7c0b9aec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.400398 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedc83-5c6e-49b3-b2d3-27d7c0b9aec5 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.406004 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adedc83-5c6e-49b3-b2d3-27d7c0b9aec5 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:28.407592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adedc83-5c6e-49b3-b2d3-27d7c0b9aec5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:28.409937 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 199/399] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:28 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:28.415686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedc83-5c6e-49b3-b2d3-27d7c0b9aec5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:28.416819 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aefb0-cadb-4932-b756-53a187fcc281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:28.417595 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aefb0-cadb-4932-b756-53a187fcc281 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.417977 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aefb0-cadb-4932-b756-53a187fcc281 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.418354 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aefb0-cadb-4932-b756-53a187fcc281 None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.419652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aefb0-cadb-4932-b756-53a187fcc281 None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:28.421603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aefb0-cadb-4932-b756-53a187fcc281 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:28.425004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 201/400] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:28 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:28.431875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aefb0-cadb-4932-b756-53a187fcc281 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:28.448148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:28.530381 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:28.551062 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aefb0-cadb-4932-b756-53a187fcc281 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:28.590159 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7cbf5-82c4-4ccc-9652-6f1f4ada1dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:28.591738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7cbf5-82c4-4ccc-9652-6f1f4ada1dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.592271 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7cbf5-82c4-4ccc-9652-6f1f4ada1dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.592746 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7cbf5-82c4-4ccc-9652-6f1f4ada1dd0 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.594180 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7cbf5-82c4-4ccc-9652-6f1f4ada1dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:28.596403 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7cbf5-82c4-4ccc-9652-6f1f4ada1dd0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:28.598504 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 202/401] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:28 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:28.604203 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7cbf5-82c4-4ccc-9652-6f1f4ada1dd0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:28.665014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedc83-5c6e-49b3-b2d3-27d7c0b9aec5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:28.703959 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ebdd7-ff81-4dba-b397-73e21392e592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:28.704912 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ebdd7-ff81-4dba-b397-73e21392e592 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.705196 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ebdd7-ff81-4dba-b397-73e21392e592 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.705511 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ebdd7-ff81-4dba-b397-73e21392e592 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72/groups/4a01ffa88e2e49109c523c0cf210c61e/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.707607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ebdd7-ff81-4dba-b397-73e21392e592 None admin] RBAC: Authorizing `identity:create_grant(project_id=787ddddee610423b947680623cefeb72, group_id=4a01ffa88e2e49109c523c0cf210c61e, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:28.709033 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ebdd7-ff81-4dba-b397-73e21392e592 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:28.722777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7cbf5-82c4-4ccc-9652-6f1f4ada1dd0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:28.732509 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 200/402] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Sep 14 15:14:28 2022] PUT /identity/v3/projects/787ddddee610423b947680623cefeb72/groups/4a01ffa88e2e49109c523c0cf210c61e/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:14:28.735389 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821711-828e-49e6-b6ab-853d6cab1a07 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.735891 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821711-828e-49e6-b6ab-853d6cab1a07 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.736973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821711-828e-49e6-b6ab-853d6cab1a07 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.739590 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 201/403] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:28.740686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8821711-828e-49e6-b6ab-853d6cab1a07 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:28.777621 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9dc14-47a3-474b-94b8-3bc0e7b91a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:28.778645 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9dc14-47a3-474b-94b8-3bc0e7b91a61 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.778756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9dc14-47a3-474b-94b8-3bc0e7b91a61 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.779041 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9dc14-47a3-474b-94b8-3bc0e7b91a61 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/groups/4a01ffa88e2e49109c523c0cf210c61e/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.781073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9dc14-47a3-474b-94b8-3bc0e7b91a61 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55, group_id=4a01ffa88e2e49109c523c0cf210c61e, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:28.783483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9dc14-47a3-474b-94b8-3bc0e7b91a61 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:28.801826 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 203/404] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Sep 14 15:14:28 2022] PUT /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/groups/4a01ffa88e2e49109c523c0cf210c61e/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:28.803495 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccb10c-ef9f-4a93-89b9-896f7dcff16b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.803865 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccb10c-ef9f-4a93-89b9-896f7dcff16b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.804153 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccb10c-ef9f-4a93-89b9-896f7dcff16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.834100 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:28.844184 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-91ccb10c-ef9f-4a93-89b9-896f7dcff16b None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:28.846579 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-91ccb10c-ef9f-4a93-89b9-896f7dcff16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:28.863308 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:28.905497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8821711-828e-49e6-b6ab-853d6cab1a07 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:28.952492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3271f-8d99-4251-a676-6d40f31bd82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:28.953210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3271f-8d99-4251-a676-6d40f31bd82d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:28.953584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3271f-8d99-4251-a676-6d40f31bd82d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:28.953930 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3271f-8d99-4251-a676-6d40f31bd82d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:28.966933 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3271f-8d99-4251-a676-6d40f31bd82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c6c3271f-8d99-4251-a676-6d40f31bd82d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:28.972809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:28.973958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:28.974948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:28.976987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 202/405] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:14:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:28.984117 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3271f-8d99-4251-a676-6d40f31bd82d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:29.002541 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 204/406] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:29.100204 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3271f-8d99-4251-a676-6d40f31bd82d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:29.131098 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:29.137259 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:29.137958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:29.138244 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:29.138513 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:29.139176 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:29.139474 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:29.140841 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:29.149922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 203/407] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:29.155483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccb10c-ef9f-4a93-89b9-896f7dcff16b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:29.329218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccb10c-ef9f-4a93-89b9-896f7dcff16b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:29.391389 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee295-face-4536-a997-3671b8bccc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:29.392426 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee295-face-4536-a997-3671b8bccc36 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:29.392931 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee295-face-4536-a997-3671b8bccc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:29.393510 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee295-face-4536-a997-3671b8bccc36 None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:29.394847 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ee295-face-4536-a997-3671b8bccc36 None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:29.396480 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ee295-face-4536-a997-3671b8bccc36 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:29.398279 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 205/408] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:29 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:29.403888 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:29.412097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee295-face-4536-a997-3671b8bccc36 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:29.433560 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:29.588476 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d287-a358-41b7-879e-1d5e6e329622 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:29.611093 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee295-face-4536-a997-3671b8bccc36 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:29.662677 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377ad56-9609-4807-9503-b61926b89161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:29.663629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377ad56-9609-4807-9503-b61926b89161 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:29.664088 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377ad56-9609-4807-9503-b61926b89161 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:29.664537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377ad56-9609-4807-9503-b61926b89161 None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:29.666179 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377ad56-9609-4807-9503-b61926b89161 None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:29.667815 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377ad56-9609-4807-9503-b61926b89161 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:29.673075 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 204/409] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:29 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:29.681364 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377ad56-9609-4807-9503-b61926b89161 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:29.687371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86b6f-5863-4438-9d00-ca2bc1e219e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:29.688250 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86b6f-5863-4438-9d00-ca2bc1e219e2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:29.688738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86b6f-5863-4438-9d00-ca2bc1e219e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:29.689216 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86b6f-5863-4438-9d00-ca2bc1e219e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:29.710732 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb86b6f-5863-4438-9d00-ca2bc1e219e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-beb86b6f-5863-4438-9d00-ca2bc1e219e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:29.725353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:29.726763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:29.727549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:29.729957 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 206/410] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:14:29.733034 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86b6f-5863-4438-9d00-ca2bc1e219e2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:29.779030 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:29.829303 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377ad56-9609-4807-9503-b61926b89161 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:29.879420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:29.887430 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c61a-9750-4834-8092-f37dae03758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:29.888104 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c61a-9750-4834-8092-f37dae03758f None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:29.888379 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c61a-9750-4834-8092-f37dae03758f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:29.888647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c61a-9750-4834-8092-f37dae03758f None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/groups/4a01ffa88e2e49109c523c0cf210c61e/roles/a0aef3a60f6e4b7494f8707e8621dece` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:29.893698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6c61a-9750-4834-8092-f37dae03758f None admin] RBAC: Authorizing `identity:create_grant(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55, group_id=4a01ffa88e2e49109c523c0cf210c61e, role_id=a0aef3a60f6e4b7494f8707e8621dece)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:29.895153 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6c61a-9750-4834-8092-f37dae03758f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:29.913371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 205/411] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Sep 14 15:14:29 2022] PUT /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55/groups/4a01ffa88e2e49109c523c0cf210c61e/roles/a0aef3a60f6e4b7494f8707e8621dece => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:14:29.926306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86b6f-5863-4438-9d00-ca2bc1e219e2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:29.975075 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:29.975694 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:29.975972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:29.976244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:29.977012 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:29.977338 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:29.978786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:29.999359 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 207/412] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:30.005839 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c61a-9750-4834-8092-f37dae03758f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:30.138752 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c61a-9750-4834-8092-f37dae03758f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:30.169342 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:30.186502 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee999d-8c57-4ee9-bbd3-d9048c2c830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:30.187524 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee999d-8c57-4ee9-bbd3-d9048c2c830c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:30.188005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee999d-8c57-4ee9-bbd3-d9048c2c830c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:30.188536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee999d-8c57-4ee9-bbd3-d9048c2c830c None admin] PATH_INFO: `/v3/groups/0f2b4eb7a0b049ceb91b957140ae60c6` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:30.189941 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee999d-8c57-4ee9-bbd3-d9048c2c830c None admin] RBAC: Authorizing `identity:get_group(group_id=0f2b4eb7a0b049ceb91b957140ae60c6)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:30.191591 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee999d-8c57-4ee9-bbd3-d9048c2c830c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:30.193402 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 206/413] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:30 2022] GET /identity/v3/groups/0f2b4eb7a0b049ceb91b957140ae60c6 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:30.199081 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:30.338752 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf01d05-56ca-4671-9cc3-db4012841c3c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:30.383203 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:30.389005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af0442-d973-49c3-9dd0-d115ccb6fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:30.390040 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af0442-d973-49c3-9dd0-d115ccb6fee3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:30.390700 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af0442-d973-49c3-9dd0-d115ccb6fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:30.390981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af0442-d973-49c3-9dd0-d115ccb6fee3 None admin] PATH_INFO: `/v3/projects/d960b8bb994249d4bc3ba704789927ea` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:30.392195 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af0442-d973-49c3-9dd0-d115ccb6fee3 None admin] RBAC: Authorizing `identity:get_project(project_id=d960b8bb994249d4bc3ba704789927ea)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:30.393790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af0442-d973-49c3-9dd0-d115ccb6fee3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:30.395419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 208/414] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:30 2022] GET /identity/v3/projects/d960b8bb994249d4bc3ba704789927ea => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:30.401377 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee999d-8c57-4ee9-bbd3-d9048c2c830c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:30.526309 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee999d-8c57-4ee9-bbd3-d9048c2c830c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:30.573868 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab7ae-fee5-4d2c-b15b-48e17af7f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:30.574539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab7ae-fee5-4d2c-b15b-48e17af7f5e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:30.574823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab7ae-fee5-4d2c-b15b-48e17af7f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:30.575108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab7ae-fee5-4d2c-b15b-48e17af7f5e4 None admin] PATH_INFO: `/v3/projects/d960b8bb994249d4bc3ba704789927ea/groups/0f2b4eb7a0b049ceb91b957140ae60c6/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:30.582589 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab7ae-fee5-4d2c-b15b-48e17af7f5e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d960b8bb994249d4bc3ba704789927ea, group_id=0f2b4eb7a0b049ceb91b957140ae60c6, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:30.584030 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab7ae-fee5-4d2c-b15b-48e17af7f5e4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:30.603492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 207/415] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Sep 14 15:14:30 2022] PUT /identity/v3/projects/d960b8bb994249d4bc3ba704789927ea/groups/0f2b4eb7a0b049ceb91b957140ae60c6/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:31.110091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42574a69-5bf1-4131-9e05-79d9affd6d31 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:31.110613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42574a69-5bf1-4131-9e05-79d9affd6d31 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:31.110721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42574a69-5bf1-4131-9e05-79d9affd6d31 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:31.112787 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 209/416] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:31.118212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202136-46ac-4971-b907-7abb6321e7b5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:31.118502 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202136-46ac-4971-b907-7abb6321e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:31.118778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92202136-46ac-4971-b907-7abb6321e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:31.146345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-92202136-46ac-4971-b907-7abb6321e7b5 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:31.147606 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-92202136-46ac-4971-b907-7abb6321e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:31.217430 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:31.247482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 208/417] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:31.611680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3e788-6f12-4a1d-8a14-a0e28c489340 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:31.612071 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3e788-6f12-4a1d-8a14-a0e28c489340 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:31.612246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3e788-6f12-4a1d-8a14-a0e28c489340 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:31.613966 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 210/418] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:31.619344 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724c86-884c-41d8-8003-979ba18b4808 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:31.619787 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724c86-884c-41d8-8003-979ba18b4808 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:31.619946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f724c86-884c-41d8-8003-979ba18b4808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:31.644137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5f724c86-884c-41d8-8003-979ba18b4808 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:31.645348 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5f724c86-884c-41d8-8003-979ba18b4808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:31.713799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 209/419] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:31.714387 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3e788-6f12-4a1d-8a14-a0e28c489340 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:31.800566 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72cd2a-4994-4aa6-a230-fbf60d3217f5 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:31.800870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72cd2a-4994-4aa6-a230-fbf60d3217f5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:31.801129 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72cd2a-4994-4aa6-a230-fbf60d3217f5 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:31.802755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 210/420] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:31.810300 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec031-cd46-41bf-85b0-8691b859a821 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:31.810592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec031-cd46-41bf-85b0-8691b859a821 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:31.810872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec031-cd46-41bf-85b0-8691b859a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:31.830171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-353ec031-cd46-41bf-85b0-8691b859a821 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:31.831363 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-353ec031-cd46-41bf-85b0-8691b859a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:31.902744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3e788-6f12-4a1d-8a14-a0e28c489340 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:31.931103 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 211/421] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:31.951631 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5429d9-720d-4579-b5de-c31d646850df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:31.952308 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5429d9-720d-4579-b5de-c31d646850df None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:31.952601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5429d9-720d-4579-b5de-c31d646850df None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:31.953001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5429d9-720d-4579-b5de-c31d646850df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:31.965418 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5429d9-720d-4579-b5de-c31d646850df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-bc5429d9-720d-4579-b5de-c31d646850df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:31.970486 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:31.971350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:31.972284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 211/422] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:14:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:31.981342 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ec031-cd46-41bf-85b0-8691b859a821 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.036003 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:32.061592 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5429d9-720d-4579-b5de-c31d646850df None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.102702 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ec031-cd46-41bf-85b0-8691b859a821 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:32.144067 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:32.146395 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:32.149128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:32.149711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:32.150580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:32.151092 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:32.152903 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:32.163158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 212/423] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:32.170248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.193652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:32.281001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5429d9-720d-4579-b5de-c31d646850df None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:32.361762 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91a559-5dc9-4ac1-8781-29e61a6ae709 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:32.363344 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:32.363522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523f20-7bb9-40a0-a39e-8edbaff87cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:32.364240 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523f20-7bb9-40a0-a39e-8edbaff87cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:32.364529 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523f20-7bb9-40a0-a39e-8edbaff87cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:32.364799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523f20-7bb9-40a0-a39e-8edbaff87cb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:32.375844 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54523f20-7bb9-40a0-a39e-8edbaff87cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-54523f20-7bb9-40a0-a39e-8edbaff87cb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:32.382089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:32.382971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:32.383790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 212/424] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:32.384921 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523f20-7bb9-40a0-a39e-8edbaff87cb9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.405257 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056964f2-a643-45a2-88eb-edb7128a9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:32.405821 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056964f2-a643-45a2-88eb-edb7128a9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:32.406102 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056964f2-a643-45a2-88eb-edb7128a9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:32.406544 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056964f2-a643-45a2-88eb-edb7128a9fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:32.496989 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523f20-7bb9-40a0-a39e-8edbaff87cb9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:32.498252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056964f2-a643-45a2-88eb-edb7128a9fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:32.499959 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056964f2-a643-45a2-88eb-edb7128a9fe9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:32.524309 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:32.543091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4350f7-220f-47ed-b1f5-a6ac409d5eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:32.543961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4350f7-220f-47ed-b1f5-a6ac409d5eea None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:32.544402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4350f7-220f-47ed-b1f5-a6ac409d5eea None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:32.545429 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4350f7-220f-47ed-b1f5-a6ac409d5eea None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:32.560452 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4350f7-220f-47ed-b1f5-a6ac409d5eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6d4350f7-220f-47ed-b1f5-a6ac409d5eea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:32.568836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:32.569835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:32.570630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 213/425] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:32.572081 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4350f7-220f-47ed-b1f5-a6ac409d5eea None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.615989 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 213/426] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:14:32.616945 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056964f2-a643-45a2-88eb-edb7128a9fe9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.619423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:32.712687 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4350f7-220f-47ed-b1f5-a6ac409d5eea None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:32.737813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056964f2-a643-45a2-88eb-edb7128a9fe9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:32.757196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:32.757858 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:32.758141 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:32.758416 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:32.759085 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:32.759390 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:32.760786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:32.769948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 214/427] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:32.770849 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.782051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:32.783164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:32.784069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:32.784547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:32.785839 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:32.786553 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:32.788326 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:32.800460 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 214/428] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:32.802025 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.820834 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:32.880170 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:32.888296 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54f670-790d-4d8b-ae10-7219a2c91dec None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:32.924339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fefdf-40fb-4757-b32e-7bd2705344a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:32.925001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fefdf-40fb-4757-b32e-7bd2705344a1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:32.925270 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fefdf-40fb-4757-b32e-7bd2705344a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:32.925569 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fefdf-40fb-4757-b32e-7bd2705344a1 None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:32.926699 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fefdf-40fb-4757-b32e-7bd2705344a1 None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:32.927812 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d0952-0658-43c2-94b1-ca26f8255c4c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:32.928122 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fefdf-40fb-4757-b32e-7bd2705344a1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:32.930053 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 215/429] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:32 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:32.931435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fefdf-40fb-4757-b32e-7bd2705344a1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:32.970730 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1f2d6-5fe5-4292-ac52-2aa75f0e94b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:32.971570 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1f2d6-5fe5-4292-ac52-2aa75f0e94b4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:32.971991 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1f2d6-5fe5-4292-ac52-2aa75f0e94b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:32.972401 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1f2d6-5fe5-4292-ac52-2aa75f0e94b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.038377 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fefdf-40fb-4757-b32e-7bd2705344a1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:33.049773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:33.062916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1f2d6-5fe5-4292-ac52-2aa75f0e94b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.065573 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1f2d6-5fe5-4292-ac52-2aa75f0e94b4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.075972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448191e-7f60-4e28-8eb1-1ace5d237044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:33.076673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448191e-7f60-4e28-8eb1-1ace5d237044 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.077055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448191e-7f60-4e28-8eb1-1ace5d237044 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.077463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448191e-7f60-4e28-8eb1-1ace5d237044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.144707 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:33.155978 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448191e-7f60-4e28-8eb1-1ace5d237044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.157482 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448191e-7f60-4e28-8eb1-1ace5d237044 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.189675 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 215/430] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:33.191328 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1f2d6-5fe5-4292-ac52-2aa75f0e94b4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:33.280873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 216/431] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:33.282121 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afae-a3fa-4164-bed3-5d65db63f7dc None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.282407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afae-a3fa-4164-bed3-5d65db63f7dc None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.282679 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afae-a3fa-4164-bed3-5d65db63f7dc None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.285437 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 217/432] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:33.285437 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733afae-a3fa-4164-bed3-5d65db63f7dc None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:33.298308 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:33.313672 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1f2d6-5fe5-4292-ac52-2aa75f0e94b4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:33.351120 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330b65-c1d4-4c6e-b564-4ad6ce0312e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:33.352088 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330b65-c1d4-4c6e-b564-4ad6ce0312e5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.352088 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330b65-c1d4-4c6e-b564-4ad6ce0312e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.352339 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330b65-c1d4-4c6e-b564-4ad6ce0312e5 None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.353459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a330b65-c1d4-4c6e-b564-4ad6ce0312e5 None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.354916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a330b65-c1d4-4c6e-b564-4ad6ce0312e5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.361535 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 216/433] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:33 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:33.361535 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330b65-c1d4-4c6e-b564-4ad6ce0312e5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:33.391861 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:33.408739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733afae-a3fa-4164-bed3-5d65db63f7dc None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:33.445581 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7669ad-a87c-49d1-bdae-49a25834042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:33.446214 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7669ad-a87c-49d1-bdae-49a25834042f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.446491 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7669ad-a87c-49d1-bdae-49a25834042f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.446763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7669ad-a87c-49d1-bdae-49a25834042f None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.447870 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7669ad-a87c-49d1-bdae-49a25834042f None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.449305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7669ad-a87c-49d1-bdae-49a25834042f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.456267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 218/434] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:33 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:33.456267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6cc50-bc97-4f3e-af72-a48c25883bfe None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.456267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6cc50-bc97-4f3e-af72-a48c25883bfe None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.456267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6cc50-bc97-4f3e-af72-a48c25883bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.471231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b4a6cc50-bc97-4f3e-af72-a48c25883bfe None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:33.472410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b4a6cc50-bc97-4f3e-af72-a48c25883bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:33.472612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330b65-c1d4-4c6e-b564-4ad6ce0312e5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:33.509342 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1aa6-6cf2-4612-b870-1f5f31c15f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:33.510061 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1aa6-6cf2-4612-b870-1f5f31c15f6b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.510429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1aa6-6cf2-4612-b870-1f5f31c15f6b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.510777 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1aa6-6cf2-4612-b870-1f5f31c15f6b None admin] PATH_INFO: `/v3/projects/787ddddee610423b947680623cefeb72` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.511978 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c1aa6-6cf2-4612-b870-1f5f31c15f6b None admin] RBAC: Authorizing `identity:get_project(project_id=787ddddee610423b947680623cefeb72)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.513450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c1aa6-6cf2-4612-b870-1f5f31c15f6b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.515213 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 217/435] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:33 2022] GET /identity/v3/projects/787ddddee610423b947680623cefeb72 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:33.520763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1aa6-6cf2-4612-b870-1f5f31c15f6b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:33.544422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 219/436] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:33.545436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6cc50-bc97-4f3e-af72-a48c25883bfe None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:33.558098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:33.632833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:33.635881 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1aa6-6cf2-4612-b870-1f5f31c15f6b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:33.655042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6cc50-bc97-4f3e-af72-a48c25883bfe None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:33.670926 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:33.671646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.671930 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.672201 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.672925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] RBAC: Adding query filter params (group.id=4a01ffa88e2e49109c523c0cf210c61e, role.id=a0aef3a60f6e4b7494f8707e8621dece, scope.project.id=787ddddee610423b947680623cefeb72) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:33.673296 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.675286 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.689351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 218/437] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:33 2022] GET /identity/v3/role_assignments?group.id=4a01ffa88e2e49109c523c0cf210c61e&scope.project.id=787ddddee610423b947680623cefeb72&role.id=a0aef3a60f6e4b7494f8707e8621dece => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:33.689351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:33.702249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516e6f5-148d-44e1-be98-ad3572175ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:33.703208 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e6f5-148d-44e1-be98-ad3572175ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.703488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e6f5-148d-44e1-be98-ad3572175ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.703763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e6f5-148d-44e1-be98-ad3572175ca5 None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.705750 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e6f5-148d-44e1-be98-ad3572175ca5 None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.708078 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e6f5-148d-44e1-be98-ad3572175ca5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.710020 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 220/438] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:33 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:33.714996 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6777b-2d7e-432e-9594-b72bce19b6c4 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.715276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6777b-2d7e-432e-9594-b72bce19b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.717595 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6777b-2d7e-432e-9594-b72bce19b6c4 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.720135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 221/439] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:33.721867 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6777b-2d7e-432e-9594-b72bce19b6c4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:33.809931 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fd4a2-8767-4f62-bdbc-660f2eab733d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:33.836523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:33.854045 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405253c-9eb7-42fb-8184-ac02bae8ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:33.855039 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405253c-9eb7-42fb-8184-ac02bae8ae09 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.855904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405253c-9eb7-42fb-8184-ac02bae8ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.856256 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405253c-9eb7-42fb-8184-ac02bae8ae09 None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.858257 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405253c-9eb7-42fb-8184-ac02bae8ae09 None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.860629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405253c-9eb7-42fb-8184-ac02bae8ae09 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.864216 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 219/440] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:33 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:33.865735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889294b-225f-4249-8f29-02c532c48acb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.866107 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889294b-225f-4249-8f29-02c532c48acb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.866423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889294b-225f-4249-8f29-02c532c48acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.867232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6777b-2d7e-432e-9594-b72bce19b6c4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:33.889475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8889294b-225f-4249-8f29-02c532c48acb None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:33.891137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8889294b-225f-4249-8f29-02c532c48acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:33.906545 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:33.907314 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:33.907531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:33.907802 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:33.909225 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] RBAC: Adding query filter params (group.id=4a01ffa88e2e49109c523c0cf210c61e, role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:33.909573 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:33.911167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:33.921453 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 222/441] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:33 2022] GET /identity/v3/role_assignments?group.id=4a01ffa88e2e49109c523c0cf210c61e&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=640205c745f84440b40441060cf8c9b4 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:33.921453 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:33.926478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:33.999849 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 220/442] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:34.000983 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889294b-225f-4249-8f29-02c532c48acb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:34.084759 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a0395-f830-4511-91d4-cf0ff8402c19 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:34.130248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889294b-225f-4249-8f29-02c532c48acb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:34.138048 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95217666-2870-4821-9e19-fda6179375bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:34.138675 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95217666-2870-4821-9e19-fda6179375bc None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:34.138961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95217666-2870-4821-9e19-fda6179375bc None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:34.139236 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95217666-2870-4821-9e19-fda6179375bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:34.143098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95217666-2870-4821-9e19-fda6179375bc None admin] RBAC: Adding query filter params (group.id=4a01ffa88e2e49109c523c0cf210c61e, role.id=640205c745f84440b40441060cf8c9b4, scope.project.id=787ddddee610423b947680623cefeb72) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:34.143098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95217666-2870-4821-9e19-fda6179375bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:34.143483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95217666-2870-4821-9e19-fda6179375bc None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:34.151378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 223/443] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:33 2022] GET /identity/v3/role_assignments?group.id=4a01ffa88e2e49109c523c0cf210c61e&scope.project.id=787ddddee610423b947680623cefeb72&role.id=640205c745f84440b40441060cf8c9b4 => generated 611 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:34.181353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76a08d-3757-4ac1-8846-ce9f6055829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:34.182035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76a08d-3757-4ac1-8846-ce9f6055829d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:34.182314 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76a08d-3757-4ac1-8846-ce9f6055829d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:34.182585 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76a08d-3757-4ac1-8846-ce9f6055829d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:34.195413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76a08d-3757-4ac1-8846-ce9f6055829d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4e76a08d-3757-4ac1-8846-ce9f6055829d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:34.200459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:34.201461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:34.202283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 221/444] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:14:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:34.209155 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95217666-2870-4821-9e19-fda6179375bc None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:34.217616 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:34.331611 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95217666-2870-4821-9e19-fda6179375bc None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:34.358675 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76a08d-3757-4ac1-8846-ce9f6055829d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:34.372468 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:34.373453 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:34.373901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:34.374184 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:34.375061 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:34.375510 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:34.377331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:34.386441 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:34.388290 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 224/445] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:34.394449 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:34.473146 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:34.485226 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76a08d-3757-4ac1-8846-ce9f6055829d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:34.515307 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aca86-7f6d-49d8-b1ab-96aab8ca792e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:34.528505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac8df4-6957-4364-acaa-0195f54d3c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:34.529146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8df4-6957-4364-acaa-0195f54d3c6a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:34.529458 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8df4-6957-4364-acaa-0195f54d3c6a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:34.529735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8df4-6957-4364-acaa-0195f54d3c6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:34.540948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac8df4-6957-4364-acaa-0195f54d3c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f9ac8df4-6957-4364-acaa-0195f54d3c6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:34.546108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:34.547021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:34.547825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 222/446] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:14:34.553227 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac8df4-6957-4364-acaa-0195f54d3c6a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:34.557943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca799ad-f0af-4c18-a215-5bcabee42a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:34.558587 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca799ad-f0af-4c18-a215-5bcabee42a31 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:34.558871 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca799ad-f0af-4c18-a215-5bcabee42a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:34.559142 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca799ad-f0af-4c18-a215-5bcabee42a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:34.643545 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca799ad-f0af-4c18-a215-5bcabee42a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:34.644940 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca799ad-f0af-4c18-a215-5bcabee42a31 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:34.651127 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:34.671958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac8df4-6957-4364-acaa-0195f54d3c6a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:34.719640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:34.723007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:34.723773 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:34.724045 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:34.724320 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:34.724987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:34.725306 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:34.726699 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:34.736602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 223/447] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:34.742195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:34.759639 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 225/448] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:14:34.766170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca799ad-f0af-4c18-a215-5bcabee42a31 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:34.874874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9372b-2032-4ad5-b20d-433d8c3cbdc4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:34.887532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca799ad-f0af-4c18-a215-5bcabee42a31 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:34.915178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503b698-418c-49bd-80b8-e0996cb6a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:34.915715 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503b698-418c-49bd-80b8-e0996cb6a5cb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:34.915997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503b698-418c-49bd-80b8-e0996cb6a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:34.916275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503b698-418c-49bd-80b8-e0996cb6a5cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:34.929611 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae6196-2b52-472b-83d1-f17841e3e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:34.930248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae6196-2b52-472b-83d1-f17841e3e22f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:34.930528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae6196-2b52-472b-83d1-f17841e3e22f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:34.930801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae6196-2b52-472b-83d1-f17841e3e22f None admin] PATH_INFO: `/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:34.931343 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:34.932010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae6196-2b52-472b-83d1-f17841e3e22f None admin] RBAC: Authorizing `identity:get_project(project_id=f5d8e8d7e95446bc9bc4905bd25a2c55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:34.933400 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae6196-2b52-472b-83d1-f17841e3e22f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:34.935015 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 226/449] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:34 2022] GET /identity/v3/projects/f5d8e8d7e95446bc9bc4905bd25a2c55 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:34.941033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae6196-2b52-472b-83d1-f17841e3e22f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:34.975939 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:34.987908 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503b698-418c-49bd-80b8-e0996cb6a5cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:34.989397 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503b698-418c-49bd-80b8-e0996cb6a5cb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:35.045721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae6196-2b52-472b-83d1-f17841e3e22f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:35.080546 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c440f-5426-4ef0-89fc-91c55935969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:35.081184 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c440f-5426-4ef0-89fc-91c55935969d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:35.081487 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c440f-5426-4ef0-89fc-91c55935969d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:35.081756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c440f-5426-4ef0-89fc-91c55935969d None admin] PATH_INFO: `/v3/groups/4a01ffa88e2e49109c523c0cf210c61e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:35.082883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c440f-5426-4ef0-89fc-91c55935969d None admin] RBAC: Authorizing `identity:get_group(group_id=4a01ffa88e2e49109c523c0cf210c61e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:35.084421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c440f-5426-4ef0-89fc-91c55935969d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:35.086020 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 227/450] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:34 2022] GET /identity/v3/groups/4a01ffa88e2e49109c523c0cf210c61e => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:35.091803 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c440f-5426-4ef0-89fc-91c55935969d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:35.107135 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 224/451] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 15:14:35.108223 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503b698-418c-49bd-80b8-e0996cb6a5cb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:35.159108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:35.201861 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c440f-5426-4ef0-89fc-91c55935969d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:35.203477 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:35.224236 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503b698-418c-49bd-80b8-e0996cb6a5cb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:35.240679 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:35.241294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:35.241602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:35.241873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:35.242602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] RBAC: Adding query filter params (group.id=4a01ffa88e2e49109c523c0cf210c61e, role.id=a0aef3a60f6e4b7494f8707e8621dece, scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:35.242935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:35.244372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:35.250333 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 228/452] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:35 2022] GET /identity/v3/role_assignments?group.id=4a01ffa88e2e49109c523c0cf210c61e&scope.project.id=f5d8e8d7e95446bc9bc4905bd25a2c55&role.id=a0aef3a60f6e4b7494f8707e8621dece => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:35.262925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2687d8-3604-4f00-8e05-0738ca610ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:35.263577 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2687d8-3604-4f00-8e05-0738ca610ec2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:35.263848 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2687d8-3604-4f00-8e05-0738ca610ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:35.264114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2687d8-3604-4f00-8e05-0738ca610ec2 None admin] PATH_INFO: `/v3/projects/d960b8bb994249d4bc3ba704789927ea` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:35.265428 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2687d8-3604-4f00-8e05-0738ca610ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=d960b8bb994249d4bc3ba704789927ea)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:35.266802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2687d8-3604-4f00-8e05-0738ca610ec2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:35.269273 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 225/453] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Sep 14 15:14:35 2022] GET /identity/v3/projects/d960b8bb994249d4bc3ba704789927ea => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:35.274957 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:35.404496 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01483572-99a8-4579-b6cf-ea96280b7fe0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:35.444190 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aa600-7248-4d29-b8e9-68ef36b1483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:35.444846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aa600-7248-4d29-b8e9-68ef36b1483b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:35.445127 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aa600-7248-4d29-b8e9-68ef36b1483b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:35.445445 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aa600-7248-4d29-b8e9-68ef36b1483b None admin] PATH_INFO: `/v3/groups/0f2b4eb7a0b049ceb91b957140ae60c6` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:35.446967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aa600-7248-4d29-b8e9-68ef36b1483b None admin] RBAC: Authorizing `identity:get_group(group_id=0f2b4eb7a0b049ceb91b957140ae60c6)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:35.448441 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aa600-7248-4d29-b8e9-68ef36b1483b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:35.450132 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 229/454] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Sep 14 15:14:35 2022] GET /identity/v3/groups/0f2b4eb7a0b049ceb91b957140ae60c6 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:35.457455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2687d8-3604-4f00-8e05-0738ca610ec2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:35.573550 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2687d8-3604-4f00-8e05-0738ca610ec2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:35.588167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:35.611643 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4860-2a35-4aee-972a-49d93d42afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:35.612255 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4860-2a35-4aee-972a-49d93d42afd1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:35.612536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4860-2a35-4aee-972a-49d93d42afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:35.612806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4860-2a35-4aee-972a-49d93d42afd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:35.613567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4860-2a35-4aee-972a-49d93d42afd1 None admin] RBAC: Adding query filter params (group.id=0f2b4eb7a0b049ceb91b957140ae60c6, role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=d960b8bb994249d4bc3ba704789927ea) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:35.613875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4860-2a35-4aee-972a-49d93d42afd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:35.615311 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4860-2a35-4aee-972a-49d93d42afd1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:35.621468 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 226/455] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Sep 14 15:14:35 2022] GET /identity/v3/role_assignments?group.id=0f2b4eb7a0b049ceb91b957140ae60c6&scope.project.id=d960b8bb994249d4bc3ba704789927ea&role.id=6211512533b744e8b1ee9031113654ac => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:38.341158 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4847be-caa9-4110-bdf6-9b2b9eacd773 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:38.342153 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4847be-caa9-4110-bdf6-9b2b9eacd773 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:38.342626 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4847be-caa9-4110-bdf6-9b2b9eacd773 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:38.344531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 230/456] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:38.350418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52db29-7c49-40e1-9761-f8f5c1cebc95 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:38.351324 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52db29-7c49-40e1-9761-f8f5c1cebc95 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:38.351819 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52db29-7c49-40e1-9761-f8f5c1cebc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:38.370748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8d52db29-7c49-40e1-9761-f8f5c1cebc95 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:38.372264 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8d52db29-7c49-40e1-9761-f8f5c1cebc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:38.444975 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 227/457] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:38.515930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b3a41-2c19-4157-8336-eb59578c227f None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:38.516546 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b3a41-2c19-4157-8336-eb59578c227f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:38.517014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b3a41-2c19-4157-8336-eb59578c227f None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:38.519679 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 231/458] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:38.525257 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6710-76cb-476c-82fa-d37d338526f6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:38.525808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6710-76cb-476c-82fa-d37d338526f6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:38.526291 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6710-76cb-476c-82fa-d37d338526f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:38.545128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-229a6710-76cb-476c-82fa-d37d338526f6 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:38.546621 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-229a6710-76cb-476c-82fa-d37d338526f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:38.625507 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 228/459] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:38.691187 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf661b5-713d-406a-9016-0647868358bc None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:38.691488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf661b5-713d-406a-9016-0647868358bc None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:38.691740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf661b5-713d-406a-9016-0647868358bc None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:38.693343 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 232/460] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:38.698486 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779c27-ff6c-4df4-9227-fd35851043fb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:38.698775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779c27-ff6c-4df4-9227-fd35851043fb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:38.699047 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779c27-ff6c-4df4-9227-fd35851043fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:38.717976 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-01779c27-ff6c-4df4-9227-fd35851043fb None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:38.719150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-01779c27-ff6c-4df4-9227-fd35851043fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:38.748617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:38.777441 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf661b5-713d-406a-9016-0647868358bc None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:38.795449 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 229/461] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:38.819426 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:38.889857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf661b5-713d-406a-9016-0647868358bc None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:38.925125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:38.925793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:38.926074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:38.926352 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:38.937075 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:38.939153 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:38.954310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:38.955779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:38.956661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:38.956661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:38.956661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:38.956661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 233/462] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:38.959966 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10c2a-d505-4ddf-867e-7b448f721a7f None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:38.960258 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10c2a-d505-4ddf-867e-7b448f721a7f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:38.960534 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10c2a-d505-4ddf-867e-7b448f721a7f None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:38.962297 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:38.962666 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 230/463] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:38.966136 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af10c2a-d505-4ddf-867e-7b448f721a7f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.053885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:39.070962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048365b-e062-4c0d-bfda-14439cd98b62 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.076622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af10c2a-d505-4ddf-867e-7b448f721a7f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.111480 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.111686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400fea8-bf29-4cf5-a6f0-ffcb984cefcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.112114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fea8-bf29-4cf5-a6f0-ffcb984cefcd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.112224 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.112377 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fea8-bf29-4cf5-a6f0-ffcb984cefcd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.112469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.112638 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fea8-bf29-4cf5-a6f0-ffcb984cefcd None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.112749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.113280 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400fea8-bf29-4cf5-a6f0-ffcb984cefcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:39.113610 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400fea8-bf29-4cf5-a6f0-ffcb984cefcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.114989 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400fea8-bf29-4cf5-a6f0-ffcb984cefcd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.124839 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.131884 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 231/464] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:39.132023 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.132101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eca07-b237-4195-b2ab-901af3729897 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.132101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eca07-b237-4195-b2ab-901af3729897 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.132101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eca07-b237-4195-b2ab-901af3729897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:39.146908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:39.147815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:39.148670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:39.148670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:39.148670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:39.148832 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8d3eca07-b237-4195-b2ab-901af3729897 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:39.148917 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 234/465] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:39.148988 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8d3eca07-b237-4195-b2ab-901af3729897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:39.149068 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.169422 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:39.215859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 232/466] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:39.216704 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eca07-b237-4195-b2ab-901af3729897 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.249349 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41df3d-fe8b-4cbf-bbc8-90ce134e4a17 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.285046 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845fd7-52e5-485c-8c85-ac02710df298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.285698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845fd7-52e5-485c-8c85-ac02710df298 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.285974 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845fd7-52e5-485c-8c85-ac02710df298 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.286242 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845fd7-52e5-485c-8c85-ac02710df298 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.286874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1845fd7-52e5-485c-8c85-ac02710df298 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.288290 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1845fd7-52e5-485c-8c85-ac02710df298 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.299253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:39.319519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 235/467] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:14:39 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:14:39.320376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845fd7-52e5-485c-8c85-ac02710df298 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.343050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eca07-b237-4195-b2ab-901af3729897 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.391861 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.394656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.395291 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.395813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.409510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.412291 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:39.434191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:39.435195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:39.436021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:39.436021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:39.436021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:39.438635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 233/468] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:39.446399 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.457962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845fd7-52e5-485c-8c85-ac02710df298 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.459728 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:39.503374 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.504576 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.505111 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.505593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.506608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:39.507096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.508802 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.529861 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 236/469] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:39.531945 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.570675 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f772-2181-4e79-9a8b-71b79d8e3e4d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.601633 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:39.613641 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.614261 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.615041 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.615324 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.615966 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:39.616273 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.617661 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.631100 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 234/470] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:39.631757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.651245 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c75f9-4e14-4914-9afb-b73a8e4a063a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.688274 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8fa3-a92e-4e3c-b326-b8e65b0944e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.689185 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8fa3-a92e-4e3c-b326-b8e65b0944e3 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.690126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8fa3-a92e-4e3c-b326-b8e65b0944e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.690663 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8fa3-a92e-4e3c-b326-b8e65b0944e3 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.691568 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e8fa3-a92e-4e3c-b326-b8e65b0944e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.693162 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e8fa3-a92e-4e3c-b326-b8e65b0944e3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.698410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:39.725517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 237/471] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:14:39 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:14:39.726786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8fa3-a92e-4e3c-b326-b8e65b0944e3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.745848 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c471b5-c3f1-4612-be4b-a466da4256ce None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.793104 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.793807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.794091 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.794367 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.808349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.809909 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:39.829267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:39.830310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:39.831179 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:39.831179 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:39.831179 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:39.833485 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 235/472] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:39.837303 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:39.885706 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8fa3-a92e-4e3c-b326-b8e65b0944e3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:39.901439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:39.942204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ed73e-284e-4244-9ffb-adc30ea2dde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:39.942795 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ed73e-284e-4244-9ffb-adc30ea2dde7 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:39.943125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ed73e-284e-4244-9ffb-adc30ea2dde7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:39.943397 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ed73e-284e-4244-9ffb-adc30ea2dde7 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:39.944082 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ed73e-284e-4244-9ffb-adc30ea2dde7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:39.946063 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ed73e-284e-4244-9ffb-adc30ea2dde7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:39.975075 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 238/473] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:14:39 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:14:39.981738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d4365-2b4e-429e-b195-557e019fde30 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:40.007363 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:40.024934 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d379eb-4f42-4f94-bb02-cf8ba9398499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:40.026146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d379eb-4f42-4f94-bb02-cf8ba9398499 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:40.026636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d379eb-4f42-4f94-bb02-cf8ba9398499 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:40.027112 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d379eb-4f42-4f94-bb02-cf8ba9398499 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:40.027946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d379eb-4f42-4f94-bb02-cf8ba9398499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:40.028449 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d379eb-4f42-4f94-bb02-cf8ba9398499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:40.030161 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d379eb-4f42-4f94-bb02-cf8ba9398499 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:40.047084 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 236/474] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:40.052982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ed73e-284e-4244-9ffb-adc30ea2dde7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:40.181339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ed73e-284e-4244-9ffb-adc30ea2dde7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:40.218702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c5a3f-9e10-402d-bada-9c5ab73d4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:40.219234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c5a3f-9e10-402d-bada-9c5ab73d4abd None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:40.219518 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c5a3f-9e10-402d-bada-9c5ab73d4abd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:40.219795 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c5a3f-9e10-402d-bada-9c5ab73d4abd None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:40.220509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c5a3f-9e10-402d-bada-9c5ab73d4abd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:40.222003 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c5a3f-9e10-402d-bada-9c5ab73d4abd None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:40.245097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 239/475] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:14:40 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:14:41.835972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4debde-81da-4ca2-a508-0f95b0afb860 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:41.836986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4debde-81da-4ca2-a508-0f95b0afb860 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:41.837508 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4debde-81da-4ca2-a508-0f95b0afb860 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:41.839293 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 237/476] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:41.844798 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606fac-7ed7-4e68-8073-346641e70aae None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:41.845722 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606fac-7ed7-4e68-8073-346641e70aae None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:41.846201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606fac-7ed7-4e68-8073-346641e70aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:41.866368 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-51606fac-7ed7-4e68-8073-346641e70aae None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:41.867922 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-51606fac-7ed7-4e68-8073-346641e70aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:41.889050 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:41.946526 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 240/477] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:42.273936 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4debde-81da-4ca2-a508-0f95b0afb860 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:42.340641 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3634c0d-2f91-433d-bf6a-c4172cba7e23 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.341339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3634c0d-2f91-433d-bf6a-c4172cba7e23 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.341840 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3634c0d-2f91-433d-bf6a-c4172cba7e23 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.349818 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 241/478] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:42.357801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8917e9-9db0-41fd-9f14-cd3e3950d90e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.357801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8917e9-9db0-41fd-9f14-cd3e3950d90e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.357801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8917e9-9db0-41fd-9f14-cd3e3950d90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.378311 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3f8917e9-9db0-41fd-9f14-cd3e3950d90e None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:42.380435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3f8917e9-9db0-41fd-9f14-cd3e3950d90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:42.406035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4debde-81da-4ca2-a508-0f95b0afb860 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:42.444437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd7bb8-3a50-41e0-a21f-adeda0d514f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:42.445068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd7bb8-3a50-41e0-a21f-adeda0d514f1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.445371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd7bb8-3a50-41e0-a21f-adeda0d514f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.445648 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd7bb8-3a50-41e0-a21f-adeda0d514f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.457597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd7bb8-3a50-41e0-a21f-adeda0d514f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0ccd7bb8-3a50-41e0-a21f-adeda0d514f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:42.462790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:42.463792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:42.464598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:42.465206 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 242/480] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:42.465275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 238/480] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:42.478897 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8917e9-9db0-41fd-9f14-cd3e3950d90e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:42.568970 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:42.575401 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca06c-88d3-43bf-a465-add2ceb64646 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.575689 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca06c-88d3-43bf-a465-add2ceb64646 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.575965 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca06c-88d3-43bf-a465-add2ceb64646 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.578617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 239/481] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:42.583837 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b36f-06ad-475f-a02f-7365caeac1d6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.584121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b36f-06ad-475f-a02f-7365caeac1d6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.584397 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b36f-06ad-475f-a02f-7365caeac1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.593168 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8917e9-9db0-41fd-9f14-cd3e3950d90e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:42.603119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5897b36f-06ad-475f-a02f-7365caeac1d6 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:42.604413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5897b36f-06ad-475f-a02f-7365caeac1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:42.631183 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:42.631807 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.632086 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.632356 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.633017 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:42.633338 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:42.634967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:42.644009 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:42.644815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 243/482] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:42.650919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:42.687243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 240/483] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:42.749384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2559-d5a1-474f-887d-b8685a9c4a16 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.749763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2559-d5a1-474f-887d-b8685a9c4a16 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.750116 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2559-d5a1-474f-887d-b8685a9c4a16 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.752886 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 241/484] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:42.757942 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af15350-b871-4c99-baa6-3d820ca98fa7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.758459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af15350-b871-4c99-baa6-3d820ca98fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.758961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af15350-b871-4c99-baa6-3d820ca98fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.771592 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96310cab-cd32-43e6-be7e-2d368f02c4f4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:42.782114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7af15350-b871-4c99-baa6-3d820ca98fa7 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:42.784194 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7af15350-b871-4c99-baa6-3d820ca98fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:42.813164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:42.814381 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.814814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.815370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.828197 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:42.829824 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:42.832663 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:42.846810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:42.848324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:42.849309 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:42.849309 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:42.849309 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:42.855206 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 244/485] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:42.855206 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:42.862742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 242/486] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:42.870320 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af15350-b871-4c99-baa6-3d820ca98fa7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:42.957345 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ca6eb-e457-4c74-a099-fe44d8ef5b4b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:42.990116 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:42.993573 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82529c-db12-4bc2-9e05-68bb4eb663dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:42.994288 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82529c-db12-4bc2-9e05-68bb4eb663dd None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:42.994641 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82529c-db12-4bc2-9e05-68bb4eb663dd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:42.994983 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82529c-db12-4bc2-9e05-68bb4eb663dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:42.995976 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af15350-b871-4c99-baa6-3d820ca98fa7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.006852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82529c-db12-4bc2-9e05-68bb4eb663dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-aa82529c-db12-4bc2-9e05-68bb4eb663dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:43.012276 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:43.013248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 245/487] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:43.018402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82529c-db12-4bc2-9e05-68bb4eb663dd None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.043152 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.043763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.044045 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.044318 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.044957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:43.045557 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.046728 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.063632 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 243/488] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:43.063632 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.085640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:43.138945 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82529c-db12-4bc2-9e05-68bb4eb663dd None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.175473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a8b10-afd9-4883-bfb5-2a0e33a8b636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.176113 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a8b10-afd9-4883-bfb5-2a0e33a8b636 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.176394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a8b10-afd9-4883-bfb5-2a0e33a8b636 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.176666 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a8b10-afd9-4883-bfb5-2a0e33a8b636 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.178808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e43d1-3bcf-447f-b821-46d95a6e9068 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.187325 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a8b10-afd9-4883-bfb5-2a0e33a8b636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e15a8b10-afd9-4883-bfb5-2a0e33a8b636 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:43.192728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:43.193665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 246/489] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:14:43.194809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a8b10-afd9-4883-bfb5-2a0e33a8b636 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.220059 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.221303 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.221611 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.221920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.222589 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:43.222883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.224270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.231986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 244/490] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:43.232844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.256591 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:43.299452 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a8b10-afd9-4883-bfb5-2a0e33a8b636 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.318260 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:43.336792 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.337384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.337519 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78c35a-3957-4fd9-9690-9095b85bdfd1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.337669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.337943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.345518 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.347456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:43.360005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:43.361028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:14:43.361952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:43.365901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 247/491] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:43.366655 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.370832 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aed0e-5174-4ad3-a8b0-0d2b93f58171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.371453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aed0e-5174-4ad3-a8b0-0d2b93f58171 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.371734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aed0e-5174-4ad3-a8b0-0d2b93f58171 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.372009 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aed0e-5174-4ad3-a8b0-0d2b93f58171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.382372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aed0e-5174-4ad3-a8b0-0d2b93f58171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f81aed0e-5174-4ad3-a8b0-0d2b93f58171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:43.387695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:43.388798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:43.389796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 245/492] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:43.390481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aed0e-5174-4ad3-a8b0-0d2b93f58171 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.468919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023dfd-daa6-43c2-aba0-44023aa51f97 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.472938 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:43.494062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aed0e-5174-4ad3-a8b0-0d2b93f58171 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.504816 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.505450 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.505730 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.506002 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.506660 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:43.506963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.508360 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.517187 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 248/493] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:43.518013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.528469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.529094 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.529403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.529686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.543430 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.544899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.558170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:43.559797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:43.560745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:43.561629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:43.561629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:43.561629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:43.561629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 246/494] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:43.562078 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.624807 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858e0d-b14b-44fe-b2e8-dd974a5eae51 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.658471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.659073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.659356 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.659629 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.660351 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:43.660655 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.662123 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.663529 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdbb5d-459b-417f-89d8-98a9300a8e2b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.697779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.698177 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 249/495] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:43.698380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.698659 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.698931 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.699040 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.699587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:43.699896 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.701265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.703074 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:43.711329 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 247/496] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:43.712138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.803099 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:43.809828 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624f3a0-a316-4096-88ca-4335bd429596 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.812827 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfc7a6-006c-4125-8ae3-57f19ef04952 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.843352 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.844043 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.844265 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.844533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.845097 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.846259 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.846546 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.846861 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:43.847772 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:43.847879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.849176 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.854923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:43.856365 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:43.862356 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 248/497] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:43.863156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:43.872077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:43.873016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:43.878701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:43.878701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:43.878701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:43.878701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 250/498] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:43.878701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:43.920011 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:43.963565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646d03f-1b69-4ded-abdc-bf87e3880cfb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.972693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546dfd-9b2d-421c-a56a-b15968bbba00 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:43.997834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805538b-a6d8-4a37-bc10-e8599c4bba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:43.998428 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805538b-a6d8-4a37-bc10-e8599c4bba99 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:43.998698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805538b-a6d8-4a37-bc10-e8599c4bba99 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:43.998965 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805538b-a6d8-4a37-bc10-e8599c4bba99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.008144 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.008778 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.009062 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.009369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.020170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.021658 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.030133 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:44.037756 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:44.038864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:44.040134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:44.040134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:44.040134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:44.040134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 251/499] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:44.040134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.069806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805538b-a6d8-4a37-bc10-e8599c4bba99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.071268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805538b-a6d8-4a37-bc10-e8599c4bba99 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.129068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.140586 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eec9a-909d-43ca-b278-74f325351e2a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.174976 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.175597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.175874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.176151 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.176288 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 249/500] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:44.176983 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805538b-a6d8-4a37-bc10-e8599c4bba99 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.183953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.185445 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:44.197073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:44.198164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 252/501] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:44.203875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.258815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.276308 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805538b-a6d8-4a37-bc10-e8599c4bba99 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.300096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7092a9-d3ca-401f-a4a4-ad9925ca27f1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.311272 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.312137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.312418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.312790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.313485 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:44.313786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.315707 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.326925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 250/502] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:44.327738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.340139 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.340748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.341024 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.341297 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.341962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:44.342263 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.343640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.346188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.355650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 253/503] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:44.356483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.430485 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c81aa-7318-4fea-937e-2f5ecde538df None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.463573 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e036a47-0f42-4c83-a3fe-6335fde0fd4f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.466986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.467619 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.467931 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.468270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.479033 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.480504 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.485082 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:44.495371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:44.496462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:44.497482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:44.497482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:44.497482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:44.497482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 251/504] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:44.497482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.503919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.504788 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.505067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.505426 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.506167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:44.506473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.507913 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.525510 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 254/505] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:44.526294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.567852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.602961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c46f1-1ec0-496d-a4b2-7775823961e8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.628808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9351d-462e-4a3c-9d38-41a87c9f0ac2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.637270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.637932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.638220 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.638492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.645755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.647203 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:44.659521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:44.660445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:44.661349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 252/506] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:44.661944 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.666550 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.667186 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.667470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.667744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.675554 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.677001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:44.688593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:44.690097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:44.691013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 255/507] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:44.691585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.730404 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.774042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5feca4-17a1-47e7-a936-7d4dcce02c75 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.800774 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.802607 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc3e9-e5a7-4dbf-adc6-7bc832e5580b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.809398 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.810005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.810283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.810554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.811182 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:44.811480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.812870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.825411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 253/508] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:44.826155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:44.840531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b4701-3ba6-4537-accf-f103505382f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.841139 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4701-3ba6-4537-accf-f103505382f9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.841490 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4701-3ba6-4537-accf-f103505382f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.841765 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4701-3ba6-4537-accf-f103505382f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.909714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b4701-3ba6-4537-accf-f103505382f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.911523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b4701-3ba6-4537-accf-f103505382f9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:44.932835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ffb2-b814-47a5-b551-13dd1dc9ae87 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:44.949473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:44.966722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:44.967326 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:44.967607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:44.967882 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:44.968612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:44.968918 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:44.970406 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.007904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 254/509] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:45.007904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.018470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 256/510] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:45.018470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b4701-3ba6-4537-accf-f103505382f9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.057685 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.110693 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c482db6-a5a9-494e-8387-fc6d847a443b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.118781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b4701-3ba6-4537-accf-f103505382f9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.145182 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.145884 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.146161 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.146431 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.147151 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:45.147455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.148890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.165963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.166446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 255/511] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:45.166969 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.167387 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.167862 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.171981 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.177113 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.179430 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.181917 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:45.196320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:45.197193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:45.198095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 257/512] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:45.198551 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.278149 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6567e5-86a0-491a-8558-7343477d2ad3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.280327 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.306045 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02592a30-1c3c-4a46-8d30-40883dfb04d0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.313760 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a16901-c76b-4c5e-8221-891a0f8f6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.314419 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a16901-c76b-4c5e-8221-891a0f8f6553 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.314693 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a16901-c76b-4c5e-8221-891a0f8f6553 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.314966 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a16901-c76b-4c5e-8221-891a0f8f6553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.341706 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.342392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.342677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.342951 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.353232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.354700 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:45.369887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:45.370910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:45.371805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:45.371805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:45.371805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:45.371805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 258/513] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:45.371805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.386292 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a16901-c76b-4c5e-8221-891a0f8f6553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.387745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a16901-c76b-4c5e-8221-891a0f8f6553 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.420642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.471398 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe80ad5-b813-48d4-be0f-94a346d9fab7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.492711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 256/514] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:45.493593 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a16901-c76b-4c5e-8221-891a0f8f6553 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.497507 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.514126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c00908-3b71-4154-9858-1c2a59e9303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.515021 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00908-3b71-4154-9858-1c2a59e9303a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.515449 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00908-3b71-4154-9858-1c2a59e9303a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.515868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00908-3b71-4154-9858-1c2a59e9303a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.589773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c00908-3b71-4154-9858-1c2a59e9303a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.591147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c00908-3b71-4154-9858-1c2a59e9303a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.601022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a16901-c76b-4c5e-8221-891a0f8f6553 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.634828 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.635430 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.635711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.635980 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.636666 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:45.636970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.638423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.639771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.662682 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 257/515] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:45.662682 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.695001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 259/516] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:45.695850 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c00908-3b71-4154-9858-1c2a59e9303a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.721574 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.759909 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673895e2-b570-4fbb-9ac1-c036c9905cdd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.793821 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c00908-3b71-4154-9858-1c2a59e9303a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.794074 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.794682 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.794967 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.795251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.795885 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:45.796190 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.797615 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.809132 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 258/517] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:45.809965 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.828717 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.829529 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.830207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.830385 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.841088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.842511 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:45.858637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:45.860329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:45.862797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:45.862797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:45.862797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:45.862797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 260/518] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:45.862797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.865793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.916730 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b361-8ffb-41b2-a1df-7d0500c0b85d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:45.939673 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:45.950856 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:45.951460 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:45.951743 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:45.952022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:45.952741 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=7eb7034159904b73bcfc7b150843be48) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:45.953045 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:45.954559 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:45.959818 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 259/519] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/role_assignments?user.id=7eb7034159904b73bcfc7b150843be48&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:45.960584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:45.963686 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c44ee9-9aec-405e-989e-789f1bd234a1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.002879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.003535 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.003815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.004091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.016273 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.017800 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:46.033648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:46.034817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:46.035755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:46.035755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:46.035755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:46.035755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 261/520] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:46.036060 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.093759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26def-aab5-4e31-bba9-80e04fcced6d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.101858 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:46.137782 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.138429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.138710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.138985 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.147605 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.149079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.152994 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461e58-2b6b-4faf-a8d6-8c6af516796d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:46.163844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:46.164919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 260/521] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:46.166362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.195596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.196237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.196518 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.196791 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.197910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:46.198217 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.199589 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.212633 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 262/522] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:46.213498 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.230044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:46.287595 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8555d36-3307-4b85-be9a-d6d65fbf8123 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.328085 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.328859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.329170 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.329479 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.330739 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:46.331046 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.332590 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.334859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7c6a8-8879-44bb-a39b-c4a806c90c3f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.352237 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 261/523] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:46.352237 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.354334 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:46.375508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.376204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.376548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.376911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.377724 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:46.378092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.379848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.398304 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 263/524] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:46.398958 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.471417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a4a0a-605b-4005-b0e5-a5fd845ff9bd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.482196 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:46.502569 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad5d71-18df-48c5-a968-3860e45448ee None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.509407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.510041 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.510319 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.510588 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.518323 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.519694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:46.530943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:46.531852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:46.532692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 262/525] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:46.533908 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.545267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.545892 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.546171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.546625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.554836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.556326 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:46.570407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:46.571369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:46.572211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 264/526] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:46.572666 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.611327 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:46.660352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de399e4c-e343-4230-a0fa-da01440e17b1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.683674 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa35ce2-c26c-4eb8-878f-b7a76e9fd98f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.697734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.698525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.698810 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.699443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.700166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=8d18577a8ba44017b686ddf1149e0244) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:46.700472 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.702264 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.709017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 263/527] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/role_assignments?user.id=8d18577a8ba44017b686ddf1149e0244&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:46.710758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.727639 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.728420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.728821 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.729192 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.730171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:46.730559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.732342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.752395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 265/528] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:46.753674 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.755074 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:46.852424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604f2a8-71d4-415d-847b-8e9a858c5b19 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.862786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:46.872093 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fad4a8-a5de-4afe-a8a6-cd6fc8ab0042 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:46.909286 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.910082 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.910633 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.910969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.912269 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:46.912648 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.914986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.921214 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c88c01-c06b-453b-b8f7-e819c6a09a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:46.922205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c88c01-c06b-453b-b8f7-e819c6a09a79 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:46.922690 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c88c01-c06b-453b-b8f7-e819c6a09a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:46.923137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c88c01-c06b-453b-b8f7-e819c6a09a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:46.925176 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c88c01-c06b-453b-b8f7-e819c6a09a79 None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=58b3ed4fedd54add9680e2968db68b71) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:46.925716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c88c01-c06b-453b-b8f7-e819c6a09a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:46.928159 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c88c01-c06b-453b-b8f7-e819c6a09a79 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:46.933483 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 264/529] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:46.937528 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:46.941676 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 266/530] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/role_assignments?user.id=58b3ed4fedd54add9680e2968db68b71&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:47.050795 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:47.061960 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802b60-5e7a-48df-a0f8-dd17a6fff6f2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:47.101998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5291c4c-9b87-4ed7-916f-f3abba45bc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:47.102622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5291c4c-9b87-4ed7-916f-f3abba45bc60 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:47.102897 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5291c4c-9b87-4ed7-916f-f3abba45bc60 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:47.103167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5291c4c-9b87-4ed7-916f-f3abba45bc60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:47.103900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5291c4c-9b87-4ed7-916f-f3abba45bc60 None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=61155f66cf144f068dabc2000afcccf6) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:47.104209 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5291c4c-9b87-4ed7-916f-f3abba45bc60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:47.105697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5291c4c-9b87-4ed7-916f-f3abba45bc60 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:47.117576 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 265/531] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:46 2022] GET /identity/v3/role_assignments?user.id=61155f66cf144f068dabc2000afcccf6&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:48.424450 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788777f2-1373-4f5b-9d26-2e642c232559 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:48.424975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788777f2-1373-4f5b-9d26-2e642c232559 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:48.424975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788777f2-1373-4f5b-9d26-2e642c232559 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:48.426599 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 267/532] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:48.432018 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a56a5-ef77-4cf2-8d69-cfe745977661 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:48.432416 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a56a5-ef77-4cf2-8d69-cfe745977661 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:48.432613 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a56a5-ef77-4cf2-8d69-cfe745977661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:48.451241 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-365a56a5-ef77-4cf2-8d69-cfe745977661 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:48.452430 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-365a56a5-ef77-4cf2-8d69-cfe745977661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:48.521900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 266/533] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:48.857698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788777f2-1373-4f5b-9d26-2e642c232559 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:48.974498 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788777f2-1373-4f5b-9d26-2e642c232559 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:49.010910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925c6b-d4ec-4580-8108-a63580a4c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:49.011606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925c6b-d4ec-4580-8108-a63580a4c601 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.011913 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925c6b-d4ec-4580-8108-a63580a4c601 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.012286 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925c6b-d4ec-4580-8108-a63580a4c601 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.023883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d925c6b-d4ec-4580-8108-a63580a4c601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-7d925c6b-d4ec-4580-8108-a63580a4c601 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:49.028707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:49.029620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:49.030420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 268/534] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:49.036888 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a56a5-ef77-4cf2-8d69-cfe745977661 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:49.127390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:49.144171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a56a5-ef77-4cf2-8d69-cfe745977661 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:49.180107 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029bed4-2deb-463c-9c4d-5f92a4429269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:49.180745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029bed4-2deb-463c-9c4d-5f92a4429269 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.181022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029bed4-2deb-463c-9c4d-5f92a4429269 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.181297 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029bed4-2deb-463c-9c4d-5f92a4429269 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.181991 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029bed4-2deb-463c-9c4d-5f92a4429269 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:49.182295 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029bed4-2deb-463c-9c4d-5f92a4429269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:49.183661 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029bed4-2deb-463c-9c4d-5f92a4429269 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:49.195906 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 267/535] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:49.202433 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925c6b-d4ec-4580-8108-a63580a4c601 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:49.226220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:49.238584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed800c-9990-4b82-bd05-4cc62467dffb None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.238919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed800c-9990-4b82-bd05-4cc62467dffb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.239150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed800c-9990-4b82-bd05-4cc62467dffb None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.241412 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 268/536] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:49.246717 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeccb6-a580-415f-9a52-d6dc4b142e0b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.246998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeccb6-a580-415f-9a52-d6dc4b142e0b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.247264 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeccb6-a580-415f-9a52-d6dc4b142e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.270228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-bfeeccb6-a580-415f-9a52-d6dc4b142e0b None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:49.271687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bfeeccb6-a580-415f-9a52-d6dc4b142e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:49.329868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925c6b-d4ec-4580-8108-a63580a4c601 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:49.361488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 269/537] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:49.371281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:49.372193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.372689 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.373171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.385534 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:49.387293 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:49.394104 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0482ec-9594-477e-95de-b0be8e9068c9 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.394395 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0482ec-9594-477e-95de-b0be8e9068c9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.395017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0482ec-9594-477e-95de-b0be8e9068c9 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.396268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 270/538] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:49.401022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e7f7-b27e-4241-a96c-df138c292502 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.401331 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e7f7-b27e-4241-a96c-df138c292502 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.401695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e7f7-b27e-4241-a96c-df138c292502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:49.404253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:49.405114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:49.406008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:49.406008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:49.406008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:49.412268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 269/539] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:49.414780 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:49.425170 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ddd3e7f7-b27e-4241-a96c-df138c292502 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:49.427656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ddd3e7f7-b27e-4241-a96c-df138c292502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:49.510741 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 271/540] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:49.511878 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:49.547670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46de7-bc60-4802-bded-fc8e7a896c63 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:49.584713 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5f6f8-9b79-4423-bbcd-0d5fbd2487c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:49.585391 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6f8-9b79-4423-bbcd-0d5fbd2487c5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.585677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6f8-9b79-4423-bbcd-0d5fbd2487c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.585952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6f8-9b79-4423-bbcd-0d5fbd2487c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.586599 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5f6f8-9b79-4423-bbcd-0d5fbd2487c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:49.586905 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5f6f8-9b79-4423-bbcd-0d5fbd2487c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:49.588288 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5f6f8-9b79-4423-bbcd-0d5fbd2487c5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:49.602114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 270/541] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:49.610717 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e7f7-b27e-4241-a96c-df138c292502 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:49.621863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:49.665425 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24c15-3157-462e-acbd-612d2b3c0902 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.665613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24c15-3157-462e-acbd-612d2b3c0902 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.665902 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24c15-3157-462e-acbd-612d2b3c0902 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.667238 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 271/542] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:49.672385 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39474cc-9ff8-4507-9c51-8190bb64916d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.672675 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39474cc-9ff8-4507-9c51-8190bb64916d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.672933 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39474cc-9ff8-4507-9c51-8190bb64916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.692229 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a39474cc-9ff8-4507-9c51-8190bb64916d None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:49.693458 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a39474cc-9ff8-4507-9c51-8190bb64916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:49.718517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e7f7-b27e-4241-a96c-df138c292502 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:49.757193 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:49.757960 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.758238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.758513 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.762454 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 272/543] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:49.763109 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39474cc-9ff8-4507-9c51-8190bb64916d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:49.776511 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:49.776511 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:49.790696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:49.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:49.792740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 272/544] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Sep 14 15:14:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:49.798084 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:49.834630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:49.878942 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39474cc-9ff8-4507-9c51-8190bb64916d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:49.885688 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:49.917092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09501f-2c1d-458b-915f-06e99184dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:49.917678 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09501f-2c1d-458b-915f-06e99184dbcb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.917960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09501f-2c1d-458b-915f-06e99184dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.918229 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09501f-2c1d-458b-915f-06e99184dbcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.923108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f48a9e-747b-4a6a-a5b8-411513616111 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:49.928719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09501f-2c1d-458b-915f-06e99184dbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3b09501f-2c1d-458b-915f-06e99184dbcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:49.933572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:49.934456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:49.935255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 273/545] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:49.936800 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09501f-2c1d-458b-915f-06e99184dbcb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:49.964543 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:49.965349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:49.965664 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:49.965978 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:49.966779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:49.967080 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:49.968698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:49.991185 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 273/546] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Sep 14 15:14:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:49.991890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.050320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09501f-2c1d-458b-915f-06e99184dbcb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.072220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:50.087246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1e5a0-00f8-406b-bdc0-4e96afacafd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.087868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1e5a0-00f8-406b-bdc0-4e96afacafd7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.088151 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1e5a0-00f8-406b-bdc0-4e96afacafd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.088416 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1e5a0-00f8-406b-bdc0-4e96afacafd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.098255 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff569ea-a8f8-4374-80fc-e6aaa380161b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.099629 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1e5a0-00f8-406b-bdc0-4e96afacafd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-25e1e5a0-00f8-406b-bdc0-4e96afacafd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:50.104501 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:50.105436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:50.106251 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 274/547] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:50.106919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1e5a0-00f8-406b-bdc0-4e96afacafd7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.126809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:50.135963 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.136557 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.136837 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.137110 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.137794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:50.138093 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.139473 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.147639 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 274/548] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:50.148412 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.210127 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1e5a0-00f8-406b-bdc0-4e96afacafd7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.244134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.244774 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.245057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.245355 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.248052 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af933343-b2c5-4d3d-a2c6-dea8d34693e5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.256049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.257538 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:50.273532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:50.274552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:50.275401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:50.275401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:50.275401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:50.275401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 275/549] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:50.275401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.286420 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453355-8ca7-419d-93dc-e2e5c9c47f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.287052 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453355-8ca7-419d-93dc-e2e5c9c47f35 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.287340 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453355-8ca7-419d-93dc-e2e5c9c47f35 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.287616 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453355-8ca7-419d-93dc-e2e5c9c47f35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.297751 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45453355-8ca7-419d-93dc-e2e5c9c47f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-45453355-8ca7-419d-93dc-e2e5c9c47f35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:50.303164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:50.304064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:50.304859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 275/550] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:50.306095 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453355-8ca7-419d-93dc-e2e5c9c47f35 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.315388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:50.359149 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:50.383797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820b539-cbee-4a74-bf61-03f8f7a72a2a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.411729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453355-8ca7-419d-93dc-e2e5c9c47f35 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.417302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.417940 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.418229 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.418894 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.419562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:50.419869 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.421256 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.429131 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 276/551] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:50.429994 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.448934 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.449591 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.449878 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.450148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.461334 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.462709 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:50.476525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:50.477607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:50.478491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:50.478491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:50.478491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:50.478491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 276/552] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:50.478727 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.525750 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:50.533167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46206f4-999f-42bb-9ba9-415ee496049a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.567716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.568325 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.568603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.568875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.569536 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:50.569836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.571217 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.583700 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:50.587032 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddade0-9ab3-4276-bdbf-74e0010fa9bf None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.588898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 277/553] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:50.589797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.622185 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.622795 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.623096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.623373 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.624081 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:50.624385 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.626174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.636530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 277/554] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:50.637360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.688139 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95732ecb-cce5-40e2-b9d5-922f171c5bdd None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.721611 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.722163 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.722443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.722714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.732908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.734520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.738008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f885b-f88a-41a5-89a7-8477e51e8221 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:50.749652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:50.750775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:50.751744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:50.751744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:50.751744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:50.751744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 278/555] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:50.751744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.760706 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:50.778248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.778869 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.779171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.779446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.780087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:50.780389 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.781786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.794132 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 278/556] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:50.794925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.818895 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:50.855389 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae7ef-5d2b-4df0-8ad9-56524f6404ff None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.889129 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.889786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.890075 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.890347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.894754 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1d32-dc7e-45a7-a9c6-bff5ef4182ff None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:50.897521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.898980 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:50.910801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:50.911714 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:50.912583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 279/557] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:50.913045 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.931391 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:50.932013 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:50.932289 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:50.932555 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:50.942544 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:50.943973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:50.959208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:50.960644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:50.961610 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:50.961610 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:50.961610 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:50.964914 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 279/558] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:50.965781 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:50.982911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.018119 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df94873-81c9-4374-9bfd-fda6ff739f19 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.039698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.054562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.055169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.055448 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.055721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.056348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:51.056650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.058054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.065814 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031f73-d358-4752-aafc-4e72232c841b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.069995 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 280/559] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:51.070780 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.101615 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.102279 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.102560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.102847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.111290 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.112732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:51.123681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:51.124788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 280/560] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:51.125778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.174645 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117366e-bc10-489e-8e50-8d5b8149e726 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.200250 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.210333 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.210946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.211228 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.211503 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.212184 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:51.212487 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.213993 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.229225 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 281/561] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:51.229225 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.229522 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccfce0-ee94-4ddd-98ff-1e885551dc2f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.263228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.263776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.264061 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.264359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.265001 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:51.265494 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.266920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.269085 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.280509 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 281/562] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:51.281428 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.333202 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00248a6b-d4a4-45f7-97ff-8cd57d33813f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.366575 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.367200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.367481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.367750 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.375084 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.376523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.387378 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa605-1436-47b9-b2fb-9b8f19b050bb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:51.388330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:51.389259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 282/563] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:51.390702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.425183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.425917 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.426199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.426469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.427190 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:51.427491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.428902 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.436127 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.446374 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 282/564] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:51.447188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.490751 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb605ed-4316-46e1-a4ec-19948c052f47 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.499501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.524314 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a6632-021b-4daa-a8ec-b1ad1d37bcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.524893 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a6632-021b-4daa-a8ec-b1ad1d37bcc1 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.525168 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a6632-021b-4daa-a8ec-b1ad1d37bcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.525482 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a6632-021b-4daa-a8ec-b1ad1d37bcc1 None admin] PATH_INFO: `/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/7eb7034159904b73bcfc7b150843be48/roles/ecd0cffe7b2b441a8a4669f7e49e97fd` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.539316 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a6632-021b-4daa-a8ec-b1ad1d37bcc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be6d4eeb19e4b57b595d5bcb139e9fb, user_id=7eb7034159904b73bcfc7b150843be48, role_id=ecd0cffe7b2b441a8a4669f7e49e97fd)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.540779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a6632-021b-4daa-a8ec-b1ad1d37bcc1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.546664 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce25fd6-afba-4274-8b41-61d0fd3743d6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.553362 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 283/565] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:51 2022] PUT /identity/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/7eb7034159904b73bcfc7b150843be48/roles/ecd0cffe7b2b441a8a4669f7e49e97fd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:51.565669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a6632-021b-4daa-a8ec-b1ad1d37bcc1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.586059 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.586707 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.586986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.587261 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.596316 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.597873 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:51.611804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:51.612874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 283/566] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:51.614568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.675492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.682107 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a6632-021b-4daa-a8ec-b1ad1d37bcc1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.721596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.722228 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.722512 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.722783 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.723533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:51.723837 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.725360 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.741271 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d5a7-a533-4232-bc0a-37c4c3c7ac27 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.749366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 284/567] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:51.749366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.765142 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.791722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.792586 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.792871 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.793140 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.805998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.807468 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:51.821758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:51.822913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:51.823970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:51.823970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:51.823970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:51.823970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 284/568] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:51.823970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.869143 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70ec5-1aa2-4775-a5da-706ba46e4bcc None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.905033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.906160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.906160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.906552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.907471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:51.907757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.909821 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:51.932630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 285/569] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:51.932630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:51.938068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12383449-4565-4e06-a254-fd3c411aff3e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:51.947156 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:51.975835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:51.976615 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:51.976997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:51.977426 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:51.990266 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:51.991736 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:52.006470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:52.007635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:52.008733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:52.008733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:52.008733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:52.009438 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 285/570] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:52.010448 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.028687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:52.045913 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02574-4553-41df-96c3-015dd81b6353 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.083362 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.084141 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.084524 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.084899 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.085695 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:52.086098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.087576 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.105711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 286/571] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:52.105711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.128147 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e0b3-a021-4963-a989-42c24f2002c1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.169199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.170245 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.171021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.171594 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.181828 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:52.185486 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.186937 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:52.203863 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:52.205560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:52.206653 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:52.206653 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:52.206653 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:52.209453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 286/572] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:52.210543 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.218927 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c6211-f9e3-4480-8528-83bb5ed82ec9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.258775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.259528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.259910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.260300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.261031 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:52.261360 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.262748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.275356 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 287/573] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:52.276179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.288259 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:52.339076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1504d57-de3b-451a-a6b7-89282125402e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.376176 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.376830 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.377111 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.377419 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.384979 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.386559 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.391448 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cea65e-ac3e-4dd8-88ff-a316e5e49025 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:52.399183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:52.400076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:52.400972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 287/574] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:52.402079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.429760 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:52.435572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.436174 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.436451 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.436721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.437372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:52.437669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.439028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.456151 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 288/575] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:52.457054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.512647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d4c52-45b7-43e7-a6bd-cce1c6619461 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.541931 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:52.550792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.551434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.551720 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.551999 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.558675 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.560128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.560523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e5728-54a0-4a64-82cc-55c38dfcee71 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:52.573825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:52.574875 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:52.576325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 288/576] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:52.578321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.606450 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.607209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.607794 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.608090 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.609171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:52.609400 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.611455 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.633127 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 289/577] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:52.633127 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.686580 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:52.695154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84b4c-8731-4a62-bf94-6715db8a576f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.735336 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.736143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.736513 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.736898 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.741438 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda7871-c83f-4a05-8bdc-6c91be5ec5ae None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.745103 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.746597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:52.761712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:52.762808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:52.763982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:52.763982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:52.763982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:52.763982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:52.763982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:52.763982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:52.763982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:52.763982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:52.768403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 289/578] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:52.769115 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.781257 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.782401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.783018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.783562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:52.783929 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.785439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.798470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 290/579] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:52.799682 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.824373 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:52.881521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed8ed2-06b5-44fa-8455-50c8689351b6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.908738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22b1dd-5b09-4e3a-a403-75bd54ded132 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:52.917821 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a1c98-2a5d-4932-91b7-edda07e96690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.918578 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1c98-2a5d-4932-91b7-edda07e96690 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.918920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1c98-2a5d-4932-91b7-edda07e96690 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.919257 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1c98-2a5d-4932-91b7-edda07e96690 None admin] PATH_INFO: `/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/8d18577a8ba44017b686ddf1149e0244/roles/ecd0cffe7b2b441a8a4669f7e49e97fd` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.922805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:52.935932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a1c98-2a5d-4932-91b7-edda07e96690 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be6d4eeb19e4b57b595d5bcb139e9fb, user_id=8d18577a8ba44017b686ddf1149e0244, role_id=ecd0cffe7b2b441a8a4669f7e49e97fd)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.937545 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a1c98-2a5d-4932-91b7-edda07e96690 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.948502 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:52.949118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:52.949433 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:52.949710 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:52.950400 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:52.950705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:52.961448 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 290/580] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:52 2022] PUT /identity/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/8d18577a8ba44017b686ddf1149e0244/roles/ecd0cffe7b2b441a8a4669f7e49e97fd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:52.961448 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a1c98-2a5d-4932-91b7-edda07e96690 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:52.961841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:52.967644 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 291/581] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:52.974464 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:53.093337 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5a9db-c632-4405-a9b3-9b5936450fd9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:53.105564 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:53.115612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a1c98-2a5d-4932-91b7-edda07e96690 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:53.135696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c61ce-d9fa-42ab-97a5-9a0c8044dab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:53.136477 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c61ce-d9fa-42ab-97a5-9a0c8044dab7 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:53.136831 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c61ce-d9fa-42ab-97a5-9a0c8044dab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:53.137180 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c61ce-d9fa-42ab-97a5-9a0c8044dab7 None admin] PATH_INFO: `/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/61155f66cf144f068dabc2000afcccf6/roles/ecd0cffe7b2b441a8a4669f7e49e97fd` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:53.155241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c61ce-d9fa-42ab-97a5-9a0c8044dab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be6d4eeb19e4b57b595d5bcb139e9fb, user_id=61155f66cf144f068dabc2000afcccf6, role_id=ecd0cffe7b2b441a8a4669f7e49e97fd)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:53.156872 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c61ce-d9fa-42ab-97a5-9a0c8044dab7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:53.172792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8a43a-1291-4c15-9248-f14f3235b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:53.174507 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a43a-1291-4c15-9248-f14f3235b39f None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:53.174976 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a43a-1291-4c15-9248-f14f3235b39f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:53.175487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a43a-1291-4c15-9248-f14f3235b39f None admin] PATH_INFO: `/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/58b3ed4fedd54add9680e2968db68b71/roles/ecd0cffe7b2b441a8a4669f7e49e97fd` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:53.175718 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 292/582] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:52 2022] PUT /identity/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/61155f66cf144f068dabc2000afcccf6/roles/ecd0cffe7b2b441a8a4669f7e49e97fd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:14:53.207406 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8a43a-1291-4c15-9248-f14f3235b39f None admin] RBAC: Authorizing `identity:create_grant(project_id=0be6d4eeb19e4b57b595d5bcb139e9fb, user_id=58b3ed4fedd54add9680e2968db68b71, role_id=ecd0cffe7b2b441a8a4669f7e49e97fd)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:53.208903 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8a43a-1291-4c15-9248-f14f3235b39f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:53.226794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 291/583] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:14:52 2022] PUT /identity/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/58b3ed4fedd54add9680e2968db68b71/roles/ecd0cffe7b2b441a8a4669f7e49e97fd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:14:53.971604 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b1d6a-4706-4abe-99ea-071a9f23e5e2 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:53.972129 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b1d6a-4706-4abe-99ea-071a9f23e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:53.972129 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b1d6a-4706-4abe-99ea-071a9f23e5e2 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:53.973754 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 293/584] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:53.979174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbbf68-bddc-4186-9eaf-996e8ef4067c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:53.979614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbbf68-bddc-4186-9eaf-996e8ef4067c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:53.979788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbbf68-bddc-4186-9eaf-996e8ef4067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:53.999362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-29cbbf68-bddc-4186-9eaf-996e8ef4067c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:54.000554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-29cbbf68-bddc-4186-9eaf-996e8ef4067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:54.068535 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 292/585] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:54.391495 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b1d6a-4706-4abe-99ea-071a9f23e5e2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:54.418562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:54.504270 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b1d6a-4706-4abe-99ea-071a9f23e5e2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:54.543263 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d626c2-eb19-4068-a27e-8b3aeef9d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:54.544296 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d626c2-eb19-4068-a27e-8b3aeef9d5ec None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:54.544781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d626c2-eb19-4068-a27e-8b3aeef9d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:54.545257 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d626c2-eb19-4068-a27e-8b3aeef9d5ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:54.556591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d626c2-eb19-4068-a27e-8b3aeef9d5ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-92d626c2-eb19-4068-a27e-8b3aeef9d5ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:54.561738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:54.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:54.563523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:54.566221 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 294/586] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:54.574284 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbbf68-bddc-4186-9eaf-996e8ef4067c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:54.658090 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:54.681928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbbf68-bddc-4186-9eaf-996e8ef4067c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:54.717517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:54.718121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:54.718395 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:54.718660 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:54.719317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:54.719617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:54.721542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:54.730073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 293/587] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:54.735687 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d626c2-eb19-4068-a27e-8b3aeef9d5ec None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:54.819235 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:54.838283 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d626c2-eb19-4068-a27e-8b3aeef9d5ec None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:54.873549 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:54.874176 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:54.874454 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:54.874781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:54.886664 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:54.888161 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:54.903443 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:54.904585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:54.905904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:54.905904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:54.905904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:54.905904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 295/588] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:54.910614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:55.018447 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c28f19-a374-4838-8a9f-8c9c3463990d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:55.054270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:55.054884 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.055163 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.055443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.056089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:55.056393 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:55.057799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:55.067138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:55.071235 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 294/589] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:55.076297 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:55.193220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573432c3-b61d-46dc-8fc3-cb7a358707bf None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:55.234043 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:55.235092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.235586 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.236124 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.238674 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:55.246985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:55.248764 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:55.261709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:55.262693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:14:55.263757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:55.266344 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 296/590] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Sep 14 15:14:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:55.272987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:55.383284 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211280c3-7d40-4c71-bae9-4cfe54e40b98 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:55.424596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db03b19-9985-4925-a793-01adbe7c49cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:55.425233 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db03b19-9985-4925-a793-01adbe7c49cc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.425555 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db03b19-9985-4925-a793-01adbe7c49cc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.425833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db03b19-9985-4925-a793-01adbe7c49cc None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.426602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db03b19-9985-4925-a793-01adbe7c49cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:55.426989 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db03b19-9985-4925-a793-01adbe7c49cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:55.428477 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db03b19-9985-4925-a793-01adbe7c49cc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:55.447824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 295/591] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Sep 14 15:14:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:55.454483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:55.567583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd539dc-a222-4b35-ab2c-40ca4d4fefe6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:55.604816 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce939d-54fd-48a6-a55a-b2659bab772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:55.605463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce939d-54fd-48a6-a55a-b2659bab772d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.605749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce939d-54fd-48a6-a55a-b2659bab772d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.606024 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce939d-54fd-48a6-a55a-b2659bab772d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.612648 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26c0b-11a6-44bb-9baa-aafbb6996fac None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.612928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26c0b-11a6-44bb-9baa-aafbb6996fac None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.613211 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26c0b-11a6-44bb-9baa-aafbb6996fac None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.614860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 296/592] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:55.621648 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d217aa-0820-45a9-bdae-3fed6fac01f7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.622091 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d217aa-0820-45a9-bdae-3fed6fac01f7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.622882 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d217aa-0820-45a9-bdae-3fed6fac01f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.645727 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f5d217aa-0820-45a9-bdae-3fed6fac01f7 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:55.647049 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f5d217aa-0820-45a9-bdae-3fed6fac01f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:55.678725 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:55.688005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce939d-54fd-48a6-a55a-b2659bab772d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:55.689981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce939d-54fd-48a6-a55a-b2659bab772d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:55.713671 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:55.729908 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 297/593] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:55.731243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b4c6-9ac7-47e0-8a78-c9cc246914e9 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.731551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b4c6-9ac7-47e0-8a78-c9cc246914e9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.731853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b4c6-9ac7-47e0-8a78-c9cc246914e9 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.733188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 298/594] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:55.739287 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960c48-1a19-4960-98ae-d9abab1a0160 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.739601 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960c48-1a19-4960-98ae-d9abab1a0160 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.739907 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960c48-1a19-4960-98ae-d9abab1a0160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.760489 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7b960c48-1a19-4960-98ae-d9abab1a0160 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:55.762108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7b960c48-1a19-4960-98ae-d9abab1a0160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:55.813372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 297/595] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:55.818358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce939d-54fd-48a6-a55a-b2659bab772d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:55.839062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 299/596] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:55.863817 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dd3a8-6fed-4515-8d66-d7a031da3e51 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.864160 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dd3a8-6fed-4515-8d66-d7a031da3e51 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.864441 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dd3a8-6fed-4515-8d66-d7a031da3e51 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.866054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 300/597] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:14:55.871119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31571-9d88-4a3d-bf7b-be12dae41e69 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.871402 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31571-9d88-4a3d-bf7b-be12dae41e69 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.871673 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31571-9d88-4a3d-bf7b-be12dae41e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:55.893014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a5a31571-9d88-4a3d-bf7b-be12dae41e69 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:55.894243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a5a31571-9d88-4a3d-bf7b-be12dae41e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:55.936543 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:55.944893 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce939d-54fd-48a6-a55a-b2659bab772d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:55.986590 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:55.987520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:55.987795 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:55.988062 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.000066 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:56.001681 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 301/598] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:14:56.002098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:56.018521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:56.019470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:56.020370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:56.020370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:56.020370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:56.022414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 298/599] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:14:56.027491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a31571-9d88-4a3d-bf7b-be12dae41e69 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.071934 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.086763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:56.160638 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a31571-9d88-4a3d-bf7b-be12dae41e69 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.190054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac36bc-d173-4724-b88d-ebfd792dbbfe None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.203626 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.204240 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.204518 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.204820 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.205499 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:56.205805 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:56.207161 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:56.219218 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 302/600] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:14:56.219911 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.228868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578199b1-5336-4207-a952-b6a9d5e665ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.229805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578199b1-5336-4207-a952-b6a9d5e665ad None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.229805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578199b1-5336-4207-a952-b6a9d5e665ad None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.230085 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578199b1-5336-4207-a952-b6a9d5e665ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.240768 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578199b1-5336-4207-a952-b6a9d5e665ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-578199b1-5336-4207-a952-b6a9d5e665ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:56.245963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:56.246898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:56.247771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 299/601] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:14:56.248493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578199b1-5336-4207-a952-b6a9d5e665ad None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.258735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:56.352603 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834147d-b636-489a-b406-3e39052dd973 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.357629 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578199b1-5336-4207-a952-b6a9d5e665ad None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.361947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:56.387844 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b4891-7093-4832-912f-b84b39326d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.388606 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4891-7093-4832-912f-b84b39326d67 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.388993 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4891-7093-4832-912f-b84b39326d67 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.389397 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4891-7093-4832-912f-b84b39326d67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.391186 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.391812 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.392097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.392390 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.399071 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:56.399650 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b4891-7093-4832-912f-b84b39326d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:56.400513 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-dc3b4891-7093-4832-912f-b84b39326d67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:56.404973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:56.406073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:56.406998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 303/602] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:56.407771 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b4891-7093-4832-912f-b84b39326d67 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:56.413982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:56.415035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:56.416152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 300/603] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:56.416801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.479772 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:56.510123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b4891-7093-4832-912f-b84b39326d67 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.515401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ff3a5-b790-4107-9fc2-712616bd217b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.543276 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.543877 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.544156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.544427 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.545072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:56.545394 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:56.546749 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:56.549855 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27b307-fc91-4894-8406-2d125438f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.550488 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27b307-fc91-4894-8406-2d125438f6db None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.550771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27b307-fc91-4894-8406-2d125438f6db None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.551046 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27b307-fc91-4894-8406-2d125438f6db None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.555138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 304/604] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:56.555986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.561902 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27b307-fc91-4894-8406-2d125438f6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4c27b307-fc91-4894-8406-2d125438f6db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:14:56.567237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:56.568166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:56.569004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 301/605] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:56.569734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27b307-fc91-4894-8406-2d125438f6db None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.588779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:56.659015 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c011-c070-474f-83c6-a07154ae758e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.669676 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27b307-fc91-4894-8406-2d125438f6db None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.690995 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.691605 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.691882 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.692155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.692808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:56.693110 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:56.694508 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:56.694814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:56.702311 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 305/606] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:56.703285 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.709505 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.710124 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.710409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.710684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.711378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:56.711689 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:56.713143 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:56.725341 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 302/607] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:56.726146 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.803761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:56.813100 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d912-0394-4efd-a345-48d19eb92edd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.824435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595236a-7832-44b8-abeb-b59699221120 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.846229 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.846854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.847134 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.847413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.857378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:56.858036 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:56.858160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:56.858438 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:56.858713 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:56.859426 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:56.859561 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:56.859724 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:56.861590 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:56.869452 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 303/608] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:56.870237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:56.874755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:56.875794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:56.877243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:56.877243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:56.877243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:56.877243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 306/609] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:56.877243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:56.921109 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:56.972591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90834-105c-45e0-bd52-50c8352f55d1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:56.978546 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59603bce-a484-4e2a-ab2a-cafb651e3255 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.006220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.006888 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.007170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.007438 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.014240 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.014842 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.015200 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.015582 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.016480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=7eb7034159904b73bcfc7b150843be48) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:57.016792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.018264 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.018375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.019763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.024072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 307/610] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/role_assignments?user.id=7eb7034159904b73bcfc7b150843be48&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:57.024852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:57.034808 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:57.035875 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:57.036869 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:57.036869 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:57.036869 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:57.036869 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 304/611] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:57.037436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.045604 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:57.155543 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355c18-3669-43bf-b9b1-4ea0dc5abe53 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.157056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:57.160935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807de60-6d53-4bd8-92db-18066114ade9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.195236 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.195879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.196154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.196423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.202442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.203660 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.204170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.204451 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.205155 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:57.205499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.207052 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.208290 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.209781 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.221152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 305/612] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:57.222324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:57.225050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:57.226026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:57.226916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:57.226916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:57.226916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:57.226916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 308/613] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:57.227148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.306893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:57.345693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9723ef-9d27-4b15-ac56-300d101048f7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.358330 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca306-ebdd-4a17-b609-d3de1f7acece None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.382244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.382952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.383324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.383603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.384241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:57.384546 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.385959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.396643 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.397273 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.397586 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.402422 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.402542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 306/614] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:57.402542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.410774 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.412135 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:57.424738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:57.425721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 309/615] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:57.426652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.429285 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:57.514292 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0a7cf-e6a6-4435-87b1-c03c23512186 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.542537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee3824-71f8-46bc-8dc5-20072367bd12 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.554619 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.555301 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.555583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.555855 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.556500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:57.556803 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.558258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.566146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:57.575850 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 307/616] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:57.575850 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.588037 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.588772 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.589113 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.589484 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.598972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.600437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:57.613109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:57.614123 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 310/617] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:57.615087 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.672911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:57.695531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e491a12-8d86-49a6-951c-befb1d3da2bc None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.719885 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159577e-1694-44e8-b78b-7720b694666f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.734005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.734602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.734881 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.735153 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.735872 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:57.736704 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.738173 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.761125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 308/618] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:57.761125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.766477 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.767113 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.767454 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.767696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.775569 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.776997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:14:57.789410 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:57.790346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 311/619] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:57.791825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:57.834275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:57.868874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6ff51-9b1e-40b7-b944-c689f4ca78e4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.897604 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53f24-66f0-490e-923d-c3dcd2b24c0d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:57.908619 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.909741 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.910179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.910622 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.911985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:57.912451 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:57.914461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:57.925472 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:57.932633 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f9eaf-ed5b-4946-86b0-70186ae7617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:57.933241 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f9eaf-ed5b-4946-86b0-70186ae7617d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:57.933556 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f9eaf-ed5b-4946-86b0-70186ae7617d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:57.933831 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f9eaf-ed5b-4946-86b0-70186ae7617d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:57.938074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 309/620] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:57.939168 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.007901 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f9eaf-ed5b-4946-86b0-70186ae7617d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.009480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f9eaf-ed5b-4946-86b0-70186ae7617d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:58.049805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283a652-228d-41a5-b254-012939b2fd96 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.057171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:58.087702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:58.088537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:58.088673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:58.088852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:58.089695 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:58.090001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.091928 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:58.117575 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 310/621] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:58.117575 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.131407 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 312/622] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:58.131776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f9eaf-ed5b-4946-86b0-70186ae7617d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.181874 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:58.231500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ae51f-8322-485a-a945-90b0fe73e9ed None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.240981 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f9eaf-ed5b-4946-86b0-70186ae7617d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.268835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08374b-404e-4dec-8707-dc96b1c336ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:58.269288 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08374b-404e-4dec-8707-dc96b1c336ee None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:58.269596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08374b-404e-4dec-8707-dc96b1c336ee None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:58.269868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08374b-404e-4dec-8707-dc96b1c336ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:58.280558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae19e9-5c66-461e-aa0d-6983090ede1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:58.281563 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae19e9-5c66-461e-aa0d-6983090ede1a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:58.281850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae19e9-5c66-461e-aa0d-6983090ede1a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:58.282157 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae19e9-5c66-461e-aa0d-6983090ede1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:58.294741 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:58.352636 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08374b-404e-4dec-8707-dc96b1c336ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.354382 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08374b-404e-4dec-8707-dc96b1c336ee None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:58.365295 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae19e9-5c66-461e-aa0d-6983090ede1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.367461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae19e9-5c66-461e-aa0d-6983090ede1a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:58.419519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:58.470461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 311/623] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:58.471907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08374b-404e-4dec-8707-dc96b1c336ee None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.485680 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 313/624] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:14:58.486940 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae19e9-5c66-461e-aa0d-6983090ede1a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.534299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:58.584468 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08374b-404e-4dec-8707-dc96b1c336ee None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.601613 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae19e9-5c66-461e-aa0d-6983090ede1a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.627172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:58.627798 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:58.628080 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:58.628531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:58.638981 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:58.639524 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.639631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:58.639871 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:58.640147 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:58.640976 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:58.650760 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.652209 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:58.657370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:58.658521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:58.659507 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:58.659507 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:58.659507 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:58.660965 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 312/625] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:58.661923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:58.671072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:58.672166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:58.673247 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:58.673247 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:58.673247 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:14:58.673247 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 314/626] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:58.673247 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.678018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:58.768810 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:58.778761 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f44bef-dd38-4186-80b3-e581a274c9a7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.778938 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0f6ce-4b01-4f89-945c-db0b7c336dbc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.814000 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:58.814900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:58.815170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:58.815479 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:58.815960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:58.816073 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:58.816267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:58.816563 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:58.816989 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:58.817295 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.818684 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:58.831983 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 315/627] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:58.832348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.832821 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.834110 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:14:58.850688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:58.851712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:14:58.852615 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:14:58.852615 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:14:58.852615 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:58.856305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 313/628] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:58.857120 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:58.917980 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:58.942529 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd2e4-c529-4803-9b1e-72fecfe75d8d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.968993 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ecf9c-fee5-432e-8fec-25fba278fea5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:58.979640 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:58.981857 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:58.981857 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:58.981857 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:58.981857 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:58.982395 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:58.983949 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.002499 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 316/629] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:59.004304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.012697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.013374 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.013711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.013990 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.022948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.023104 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:59.024978 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:59.039735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:59.040853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:59.041835 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 314/630] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:59.042354 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.148350 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370677c-26e6-4c59-b1f6-1c3297f8b217 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.173969 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb072b22-a081-4dcf-9942-8f5f77c2fd55 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.186210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.186924 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.187208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.187481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.188107 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:59.188408 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.190416 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.196190 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:59.205726 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 317/631] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:59.211149 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.218757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.219496 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.219855 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.220854 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.230219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.231665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:59.244785 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:59.245734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:59.246628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 315/632] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:59.247123 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.296112 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:59.347227 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550a4eb-a9cb-4ab6-901d-4e0258e9223c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.387748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59c68d-634f-4c28-a0a5-8310acc2ca25 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.393242 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.393888 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.394523 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.394793 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.395492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:59.396076 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.398258 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.415233 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 318/633] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:59.416094 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.432789 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.433943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.434481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.434960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.443694 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.445149 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:14:59.456555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:14:59.457517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:14:59.458409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 316/634] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:14:59.458898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.505793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:59.535372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519713-9223-4533-9114-1a2180c292ba None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.563628 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:59.565936 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45cf4f-2fed-4934-a576-ff548d1b0580 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.569769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.570376 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.570656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.570929 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.571612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:59.571916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.573339 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.585839 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 319/635] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:59.586646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.600367 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf5ba5-8bcb-4d62-87a4-7cbda6a84361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.601084 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5ba5-8bcb-4d62-87a4-7cbda6a84361 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.601399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5ba5-8bcb-4d62-87a4-7cbda6a84361 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.601750 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5ba5-8bcb-4d62-87a4-7cbda6a84361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.602674 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf5ba5-8bcb-4d62-87a4-7cbda6a84361 None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=8d18577a8ba44017b686ddf1149e0244) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:59.603023 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf5ba5-8bcb-4d62-87a4-7cbda6a84361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.604681 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf5ba5-8bcb-4d62-87a4-7cbda6a84361 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.613142 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 317/636] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/role_assignments?user.id=8d18577a8ba44017b686ddf1149e0244&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:59.614453 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa637c-b716-4bff-ab21-a6e30d9dbb9a None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.614747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa637c-b716-4bff-ab21-a6e30d9dbb9a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.615026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa637c-b716-4bff-ab21-a6e30d9dbb9a None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.616214 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 318/637] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:14:59.617445 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa637c-b716-4bff-ab21-a6e30d9dbb9a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.712621 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3fa0-f84a-4141-bce5-1c331cc058e9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.734386 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa637c-b716-4bff-ab21-a6e30d9dbb9a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.736064 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:59.761261 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea671c-e3fd-49c8-9a82-17f0b1944c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.761940 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea671c-e3fd-49c8-9a82-17f0b1944c4a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.762223 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea671c-e3fd-49c8-9a82-17f0b1944c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.762495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea671c-e3fd-49c8-9a82-17f0b1944c4a None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.763211 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea671c-e3fd-49c8-9a82-17f0b1944c4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:59.763523 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea671c-e3fd-49c8-9a82-17f0b1944c4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.765014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea671c-e3fd-49c8-9a82-17f0b1944c4a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.784853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 320/638] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:59.784853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca385d7-da49-4999-a08b-339cf5662c21 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.784853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca385d7-da49-4999-a08b-339cf5662c21 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.784853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca385d7-da49-4999-a08b-339cf5662c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.787095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.787728 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.788006 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.788281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.789037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=61155f66cf144f068dabc2000afcccf6) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:59.789361 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.790839 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.797203 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 319/639] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/role_assignments?user.id=61155f66cf144f068dabc2000afcccf6&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:14:59.798075 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:14:59.810426 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-1ca385d7-da49-4999-a08b-339cf5662c21 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:14:59.812058 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1ca385d7-da49-4999-a08b-339cf5662c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:14:59.877187 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:14:59.909348 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 321/640] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:14:59.942771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ab9d-fb11-46ce-9324-a9a20a0db0c5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:14:59.984182 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:14:59.984813 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:14:59.985094 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:14:59.985400 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:14:59.986178 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=58b3ed4fedd54add9680e2968db68b71) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:14:59.986496 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:14:59.987975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:14:59.994972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 320/641] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:14:59 2022] GET /identity/v3/role_assignments?user.id=58b3ed4fedd54add9680e2968db68b71&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:00.246587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca385d7-da49-4999-a08b-339cf5662c21 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:00.357592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca385d7-da49-4999-a08b-339cf5662c21 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:00.394668 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72debf-30fd-48bf-9982-618ed044c3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:00.395308 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72debf-30fd-48bf-9982-618ed044c3a9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:00.395588 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72debf-30fd-48bf-9982-618ed044c3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:00.395860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72debf-30fd-48bf-9982-618ed044c3a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:00.409922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72debf-30fd-48bf-9982-618ed044c3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7e72debf-30fd-48bf-9982-618ed044c3a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:00.414883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:00.415872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:00.416769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 322/642] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:15:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:00.421900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:00.456369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:00.537627 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71278c6-eb63-4465-be4f-7bf27aa4369d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:00.573288 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:00.573932 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:00.574210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:00.574544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:00.575136 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:00.575432 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:00.576800 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:00.587012 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 321/643] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:15:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:00.592627 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72debf-30fd-48bf-9982-618ed044c3a9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:00.644539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:00.705182 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72debf-30fd-48bf-9982-618ed044c3a9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:00.739612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:00.740242 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:00.740521 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:00.740793 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:00.752032 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:00.753569 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:00.769719 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:00.770710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:00.771624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:00.771624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:00.771624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:00.771624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 323/644] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:00.776912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:00.877664 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:00.888721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56b9c-28ad-4bb0-afcb-b9563aa53011 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:00.924517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:00.925129 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:00.925576 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:00.925856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:00.926551 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:00.926855 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:00.928222 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:00.941461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 322/645] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:00.946760 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:01.048960 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:01.055916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977ab5-ec4f-4d98-9594-7e57fd8a3ff7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:01.094090 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:01.094735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:01.095019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:01.095325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] PATH_INFO: `/v3/users/nova` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:01.104019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:01.105606 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:01.118855 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:01.119899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:15:01.120858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:01.125307 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 324/646] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Sep 14 15:15:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:01.127333 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:01.237134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66812745-b974-4136-9b9a-2e5f85843621 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:01.275747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:01.276371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:01.276653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:01.276932 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:01.277764 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:01.278081 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:01.279528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:01.304372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 323/647] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Sep 14 15:15:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:01.309370 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:01.420966 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc71c1-ee1f-4698-98eb-e08d31852bff None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:01.458085 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ef22e-1cf0-4dea-a276-0f1755519867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:01.459039 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ef22e-1cf0-4dea-a276-0f1755519867 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:01.459550 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ef22e-1cf0-4dea-a276-0f1755519867 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:01.460060 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ef22e-1cf0-4dea-a276-0f1755519867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:01.484906 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:01.533730 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ef22e-1cf0-4dea-a276-0f1755519867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:01.535538 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ef22e-1cf0-4dea-a276-0f1755519867 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:01.641959 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 325/648] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 15:15:01.653427 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:01.666218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:01.760212 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c92e3-ce15-42ca-af66-be9bb1cc99af None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:01.799094 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:01.799658 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:01.799931 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:01.800196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:01.811282 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:01.812937 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:01.830172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:01.831147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:01.832039 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:01.832039 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:01.832039 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:01.832039 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 324/649] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:01.836986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ef22e-1cf0-4dea-a276-0f1755519867 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:01.902041 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:01.951125 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ef22e-1cf0-4dea-a276-0f1755519867 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:01.988797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:01.989443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:01.989724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:01.989993 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:01.990638 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:01.990939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:01.992321 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:02.005853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 326/650] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:02.011139 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:02.083948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:02.130515 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd4f7-222f-4f5a-98af-c40069361e83 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:02.171137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c88038-81a7-4ab7-82de-9bae98322c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:02.171962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c88038-81a7-4ab7-82de-9bae98322c0d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.172241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c88038-81a7-4ab7-82de-9bae98322c0d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.172512 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c88038-81a7-4ab7-82de-9bae98322c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.179731 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c88038-81a7-4ab7-82de-9bae98322c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:02.181181 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c88038-81a7-4ab7-82de-9bae98322c0d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-71c88038-81a7-4ab7-82de-9bae98322c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:02.192904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:02.193883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:02.194777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 325/651] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:02.199943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:02.317244 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a92c0a-0379-4f40-9c55-9fea98ad32ad None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:02.332838 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ddef4-82a9-452b-9dbf-501c4883b725 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.333200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ddef4-82a9-452b-9dbf-501c4883b725 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.333679 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ddef4-82a9-452b-9dbf-501c4883b725 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.333846 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:02.335293 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 326/652] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:02.345326 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328465d-f497-4c14-922c-4dace01c61dd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.345326 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328465d-f497-4c14-922c-4dace01c61dd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.345326 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328465d-f497-4c14-922c-4dace01c61dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.359981 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:02.360823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.361306 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.361749 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.362455 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7328465d-f497-4c14-922c-4dace01c61dd None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:02.362861 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:02.363312 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:02.364834 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7328465d-f497-4c14-922c-4dace01c61dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:02.365158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:02.378726 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 327/653] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:02.388828 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:02.443810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 327/654] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:15:02.466093 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb3668-03a1-457d-8566-638b54271d8f None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.466378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb3668-03a1-457d-8566-638b54271d8f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.466651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb3668-03a1-457d-8566-638b54271d8f None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.468391 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 328/655] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:15:02.474057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667283d7-9a6a-4e6a-998c-f4ed169a02f2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.474346 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667283d7-9a6a-4e6a-998c-f4ed169a02f2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.474624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667283d7-9a6a-4e6a-998c-f4ed169a02f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.494050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416146a-7268-4933-bdff-b8ab891fe170 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:02.495350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-667283d7-9a6a-4e6a-998c-f4ed169a02f2 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:02.497462 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-667283d7-9a6a-4e6a-998c-f4ed169a02f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:02.538205 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cd7b4-cc5f-4879-aa69-e1a9a37362da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:02.538906 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd7b4-cc5f-4879-aa69-e1a9a37362da None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.539185 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd7b4-cc5f-4879-aa69-e1a9a37362da None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.539480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cd7b4-cc5f-4879-aa69-e1a9a37362da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.540217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cd7b4-cc5f-4879-aa69-e1a9a37362da None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=7eb7034159904b73bcfc7b150843be48) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:02.540480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cd7b4-cc5f-4879-aa69-e1a9a37362da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:02.542120 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cd7b4-cc5f-4879-aa69-e1a9a37362da None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:02.556229 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 328/656] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:15:02 2022] GET /identity/v3/role_assignments?user.id=7eb7034159904b73bcfc7b150843be48&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=6211512533b744e8b1ee9031113654ac => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:02.566397 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:02.575542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37211ad-f1cd-4cb4-92ce-db270412c9a0 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.575896 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37211ad-f1cd-4cb4-92ce-db270412c9a0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.576142 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37211ad-f1cd-4cb4-92ce-db270412c9a0 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.578178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 329/657] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:15:02.584481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d158-e02b-45f5-98e5-8dbd951e9359 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.584792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d158-e02b-45f5-98e5-8dbd951e9359 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.585032 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d158-e02b-45f5-98e5-8dbd951e9359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.591960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 329/658] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:15:02.610729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f911d158-e02b-45f5-98e5-8dbd951e9359 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:02.612936 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f911d158-e02b-45f5-98e5-8dbd951e9359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:02.652404 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:02.694828 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 330/659] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:15:02.778492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667283d7-9a6a-4e6a-998c-f4ed169a02f2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:02.880325 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667283d7-9a6a-4e6a-998c-f4ed169a02f2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:02.914556 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:02.915192 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:02.915467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:02.915737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:02.916316 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:02.917711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:02.929038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:02.930088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:02.930943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 330/660] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Sep 14 15:15:02 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:02.936194 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d158-e02b-45f5-98e5-8dbd951e9359 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:02.964722 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.013652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:03.056960 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d158-e02b-45f5-98e5-8dbd951e9359 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.074917 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff109dda-b369-4cec-a671-4525d3fdf3d9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.092451 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.093057 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.093354 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.093627 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.094252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] RBAC: Adding query filter params (name=image) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:03.094551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.096445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.101226 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 331/661] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:03.102163 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.115762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.116596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.116949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.117500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] PATH_INFO: `/v3/services/network` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.118131 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.119516 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:03.128770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:03.130294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:03.131232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 331/662] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:02 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:03.132064 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.142609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:03.221156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be0e72-e5c6-46f4-b8a0-80e6dda21746 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.255093 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c642f-19ef-42e8-82ec-21ee0b324b8c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.259943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.260576 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.260853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.261121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.261737 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.263105 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.266196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:03.274854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:03.275910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:03.276748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 332/663] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Sep 14 15:15:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:03.278264 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.297856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.298528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.299317 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.300018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.300655 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] RBAC: Adding query filter params (type=image) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:03.300958 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.302376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.308450 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 332/664] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:03.309098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.403323 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:03.413043 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e158b-1a66-45b2-b298-ee5965ad8f3e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.446440 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8fd54-942b-4371-a63b-f1439fb2b5cb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.456378 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.457005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.457289 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.457592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.458230 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] RBAC: Adding query filter params (name=network) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:03.458534 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.459942 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.469917 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 333/665] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:03.471537 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.490868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.491948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.492503 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.492970 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.493892 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:03.494415 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.496189 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.502252 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 333/666] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Sep 14 15:15:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:03.509262 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:03.566494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:03.604731 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d878d1d-0da9-45dd-8f97-11635393bbcf None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.634236 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f239-a1b4-49da-902b-b2a2bbe735fa None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:03.649635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd73fdb-ddb9-437f-bf8a-34957e3597d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.650245 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd73fdb-ddb9-437f-bf8a-34957e3597d8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.650524 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd73fdb-ddb9-437f-bf8a-34957e3597d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.650860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd73fdb-ddb9-437f-bf8a-34957e3597d8 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.651486 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd73fdb-ddb9-437f-bf8a-34957e3597d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:03.651785 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd73fdb-ddb9-437f-bf8a-34957e3597d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.653414 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd73fdb-ddb9-437f-bf8a-34957e3597d8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.659984 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 334/667] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:03.677202 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8c9f1-a0b6-46af-9935-08e1598455eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:03.678239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c9f1-a0b6-46af-9935-08e1598455eb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:03.678746 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c9f1-a0b6-46af-9935-08e1598455eb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:03.679231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c9f1-a0b6-46af-9935-08e1598455eb None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:03.680083 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8c9f1-a0b6-46af-9935-08e1598455eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:03.680665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8c9f1-a0b6-46af-9935-08e1598455eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:03.682343 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8c9f1-a0b6-46af-9935-08e1598455eb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:03.688461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 334/668] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Sep 14 15:15:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:05.012946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ccaa1-2e00-462b-8374-00b82cb1af41 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.013490 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ccaa1-2e00-462b-8374-00b82cb1af41 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.013601 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ccaa1-2e00-462b-8374-00b82cb1af41 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.015187 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 335/669] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:05.021025 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fcf3d-f48b-45c4-9a87-c8d8eaf0417d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.021473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fcf3d-f48b-45c4-9a87-c8d8eaf0417d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.021670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fcf3d-f48b-45c4-9a87-c8d8eaf0417d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.043773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ba0fcf3d-f48b-45c4-9a87-c8d8eaf0417d None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:05.044957 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ba0fcf3d-f48b-45c4-9a87-c8d8eaf0417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:05.121701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 335/670] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:15:05.447633 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ccaa1-2e00-462b-8374-00b82cb1af41 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:05.476144 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:05.562438 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ccaa1-2e00-462b-8374-00b82cb1af41 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:05.599089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bdc8f-e996-4c05-a020-27e90c5c9fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:05.599964 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdc8f-e996-4c05-a020-27e90c5c9fff None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.600388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdc8f-e996-4c05-a020-27e90c5c9fff None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.600804 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdc8f-e996-4c05-a020-27e90c5c9fff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.612417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bdc8f-e996-4c05-a020-27e90c5c9fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c09bdc8f-e996-4c05-a020-27e90c5c9fff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:05.617969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:05.619048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:05.620063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:05.622273 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 336/671] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:15:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:05.630786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fcf3d-f48b-45c4-9a87-c8d8eaf0417d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:05.661780 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:05.746998 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fcf3d-f48b-45c4-9a87-c8d8eaf0417d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:05.785068 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9f7e0-affd-4648-9626-00c953ea5487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:05.785718 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9f7e0-affd-4648-9626-00c953ea5487 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.785995 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9f7e0-affd-4648-9626-00c953ea5487 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.786262 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9f7e0-affd-4648-9626-00c953ea5487 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.786919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9f7e0-affd-4648-9626-00c953ea5487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:05.787214 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9f7e0-affd-4648-9626-00c953ea5487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:05.788578 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9f7e0-affd-4648-9626-00c953ea5487 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:05.797702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 336/672] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:15:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:05.803578 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bdc8f-e996-4c05-a020-27e90c5c9fff None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:05.902490 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:05.921201 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bdc8f-e996-4c05-a020-27e90c5c9fff None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:05.931548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d9fd-4bfb-495b-b6d2-87c0431b7592 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.931548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d9fd-4bfb-495b-b6d2-87c0431b7592 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.931548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d9fd-4bfb-495b-b6d2-87c0431b7592 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.935783 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 337/673] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:15:05.937682 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b00db-daa4-427e-82ec-358ae334fe96 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.938054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b00db-daa4-427e-82ec-358ae334fe96 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.938394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b00db-daa4-427e-82ec-358ae334fe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.959521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4e3b00db-daa4-427e-82ec-358ae334fe96 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:05.961113 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4e3b00db-daa4-427e-82ec-358ae334fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:05.961941 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:05.962833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:05.963287 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:05.963781 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:05.976055 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:05.977550 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:05.994549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:05.995558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:06.001019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:06.001019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:06.001019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:06.001019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 337/674] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:06.003423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.065339 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 338/675] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:15:06.115950 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f2523-0cc3-42a8-8690-c160e457679d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.155660 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.156200 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.156661 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.156846 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.157527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:06.157865 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:06.159013 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221842-e51e-46c2-81a1-2324a48cd44b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.159251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:06.159700 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221842-e51e-46c2-81a1-2324a48cd44b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.160162 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221842-e51e-46c2-81a1-2324a48cd44b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.162753 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 339/676] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:06.167643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1780d-9fa5-4f2a-a6cb-15390cd2a100 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.167859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1780d-9fa5-4f2a-a6cb-15390cd2a100 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.168190 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1780d-9fa5-4f2a-a6cb-15390cd2a100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.172311 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:06.179698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 338/677] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:06.185756 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.192732 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-abe1780d-9fa5-4f2a-a6cb-15390cd2a100 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:06.193958 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-abe1780d-9fa5-4f2a-a6cb-15390cd2a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:06.213689 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:06.266289 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 340/678] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 15:15:06.268037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2807-afc5-495e-80f7-79d37aa4d8bb None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.268455 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2807-afc5-495e-80f7-79d37aa4d8bb None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.268750 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2807-afc5-495e-80f7-79d37aa4d8bb None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.270355 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 341/679] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:06.278966 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b926cec-2095-4b84-a6ec-3afe725439cd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.279372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b926cec-2095-4b84-a6ec-3afe725439cd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.279751 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b926cec-2095-4b84-a6ec-3afe725439cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.296385 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31223-7ad2-4b24-aebc-2506ae570258 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.299569 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5b926cec-2095-4b84-a6ec-3afe725439cd None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:06.300364 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5b926cec-2095-4b84-a6ec-3afe725439cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:06.333412 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.334038 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.334315 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.334631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.343755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:06.345214 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:06.375853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:06.377597 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:15:06.378635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:06.381499 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 339/680] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Sep 14 15:15:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:06.389477 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.432477 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 342/681] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 15:15:06.433231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b926cec-2095-4b84-a6ec-3afe725439cd None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.463664 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:06.514310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eab4-74a5-40ed-93ec-4b2c3a8ee22f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.560823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.560823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.560823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.560823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.561838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:06.561838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:06.562172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:06.584289 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 340/682] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Sep 14 15:15:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:06.589119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.618511 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:06.640363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b926cec-2095-4b84-a6ec-3afe725439cd None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.675194 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca5760-dadf-4568-b774-bcc09f039804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.675805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca5760-dadf-4568-b774-bcc09f039804 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.676080 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca5760-dadf-4568-b774-bcc09f039804 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.676349 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca5760-dadf-4568-b774-bcc09f039804 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.676988 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca5760-dadf-4568-b774-bcc09f039804 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:06.678376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca5760-dadf-4568-b774-bcc09f039804 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:06.695154 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 343/683] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:15:06 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:06.699001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca5760-dadf-4568-b774-bcc09f039804 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.713884 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d14c1f-4ded-46ce-aa1c-f0e2acd84afe None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.737733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:06.784117 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.784770 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.785053 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.785349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.797132 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:06.799267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:06.815022 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:06.816228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:06.817532 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:06.817532 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:06.817532 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:06.820924 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 341/684] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:06.821887 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.825267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca5760-dadf-4568-b774-bcc09f039804 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:06.868205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d82b0-97cf-4c23-b98a-4986583d515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:06.868940 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d82b0-97cf-4c23-b98a-4986583d515b None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:06.869224 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d82b0-97cf-4c23-b98a-4986583d515b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:06.869554 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d82b0-97cf-4c23-b98a-4986583d515b None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:06.870330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d82b0-97cf-4c23-b98a-4986583d515b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:06.871732 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d82b0-97cf-4c23-b98a-4986583d515b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:06.897345 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 344/685] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:15:06 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:06.897345 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d82b0-97cf-4c23-b98a-4986583d515b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:06.901935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:06.966453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06d5da-03ed-418c-9a45-fcd752e4a546 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.027693 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23c38-1aa9-4f7f-9744-8779d807643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.028569 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23c38-1aa9-4f7f-9744-8779d807643a None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.029000 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23c38-1aa9-4f7f-9744-8779d807643a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.029506 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23c38-1aa9-4f7f-9744-8779d807643a None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.030390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad23c38-1aa9-4f7f-9744-8779d807643a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.032101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad23c38-1aa9-4f7f-9744-8779d807643a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.038278 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d82b0-97cf-4c23-b98a-4986583d515b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.055385 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 342/686] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:15:06 2022] POST /identity/v3/services => generated 240 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:07.086571 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.087210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.087493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.087766 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.088440 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:07.090067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.090198 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.108877 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 345/687] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:07.118497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23c38-1aa9-4f7f-9744-8779d807643a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:07.149162 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:07.248265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23c38-1aa9-4f7f-9744-8779d807643a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.289417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.290323 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.290606 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.290876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.299371 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.300838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:07.313748 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:07.314733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:07.315622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 343/688] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:07.322125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:07.388888 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:07.432389 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786e16-f6e1-4d14-b293-57f8c983318b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.468481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133cc2e-6c8a-465e-bd46-cad8a17e34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.469102 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133cc2e-6c8a-465e-bd46-cad8a17e34fb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.469410 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133cc2e-6c8a-465e-bd46-cad8a17e34fb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.469684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133cc2e-6c8a-465e-bd46-cad8a17e34fb None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.470922 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133cc2e-6c8a-465e-bd46-cad8a17e34fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:07.471231 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133cc2e-6c8a-465e-bd46-cad8a17e34fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.472661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133cc2e-6c8a-465e-bd46-cad8a17e34fb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.485300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 346/689] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:07.491270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:07.577167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:07.600437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b40e-4e93-466d-aa7e-adc9f0654573 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:07.636636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe0f5d-6053-40c4-a7ab-4746f8d8e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:07.637375 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0f5d-6053-40c4-a7ab-4746f8d8e594 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:07.637660 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0f5d-6053-40c4-a7ab-4746f8d8e594 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:07.637937 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0f5d-6053-40c4-a7ab-4746f8d8e594 None admin] PATH_INFO: `/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/7eb7034159904b73bcfc7b150843be48/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:07.639890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe0f5d-6053-40c4-a7ab-4746f8d8e594 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be6d4eeb19e4b57b595d5bcb139e9fb, user_id=7eb7034159904b73bcfc7b150843be48, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:07.641501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe0f5d-6053-40c4-a7ab-4746f8d8e594 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:07.659099 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 344/690] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:15:07 2022] PUT /identity/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/7eb7034159904b73bcfc7b150843be48/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:15:09.296704 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ee85e-8146-4263-b6bd-8faa88cd45c0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:09.297490 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ee85e-8146-4263-b6bd-8faa88cd45c0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:09.297490 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ee85e-8146-4263-b6bd-8faa88cd45c0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:09.299514 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 347/691] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:09.316304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6d596-9eaa-4069-9164-2828fbde620f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:09.317154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6d596-9eaa-4069-9164-2828fbde620f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:09.317609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6d596-9eaa-4069-9164-2828fbde620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:09.336284 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5ee6d596-9eaa-4069-9164-2828fbde620f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:09.337523 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5ee6d596-9eaa-4069-9164-2828fbde620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:09.408366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309555e-3a92-4ff1-a376-b64ea3cc8d9a None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:09.408637 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 345/692] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:09.408820 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309555e-3a92-4ff1-a376-b64ea3cc8d9a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:09.409085 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309555e-3a92-4ff1-a376-b64ea3cc8d9a None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:09.410555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 348/693] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:15:09.415701 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930309-df8c-41a8-bed0-c060a7801fe0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:09.415990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930309-df8c-41a8-bed0-c060a7801fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:09.416268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930309-df8c-41a8-bed0-c060a7801fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:09.434657 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-57930309-df8c-41a8-bed0-c060a7801fe0 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:09.435843 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-57930309-df8c-41a8-bed0-c060a7801fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:09.502185 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:09.508303 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 346/694] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:09.602326 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0afb8-c393-4e5d-aa63-d976b6f0f884 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:09.602614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0afb8-c393-4e5d-aa63-d976b6f0f884 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:09.602890 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0afb8-c393-4e5d-aa63-d976b6f0f884 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:09.604472 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 349/695] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:09.609686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbbb9-b438-4b65-b0fa-081cebff7f16 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:09.609979 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbbb9-b438-4b65-b0fa-081cebff7f16 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:09.610260 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbbb9-b438-4b65-b0fa-081cebff7f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:09.628380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-acdfbbb9-b438-4b65-b0fa-081cebff7f16 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:09.629808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-acdfbbb9-b438-4b65-b0fa-081cebff7f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:09.703594 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 347/696] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:09.749494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0afb8-c393-4e5d-aa63-d976b6f0f884 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:09.841639 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfbbb9-b438-4b65-b0fa-081cebff7f16 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:09.859795 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0afb8-c393-4e5d-aa63-d976b6f0f884 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:09.885823 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:09.901347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:09.901991 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:09.902269 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:09.902536 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] PATH_INFO: `/v3/services/image` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:09.903108 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:09.904471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:09.914405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:09.915630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:09.916509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 350/697] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Sep 14 15:15:09 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:09.922524 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:09.977251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfbbb9-b438-4b65-b0fa-081cebff7f16 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.015611 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:10.029237 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.029893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.031460 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.031732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.032312 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.033767 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:10.042757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:10.043768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:10.044644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 348/698] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Sep 14 15:15:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:10.049563 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.056311 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2fa10-ee83-4aa2-9c4f-e54231f81ae8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.093023 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.093664 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.093944 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.094215 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.094841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] RBAC: Adding query filter params (name=image) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:10.095143 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.096608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.101419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 351/699] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:10.102049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.153073 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:10.161995 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21262bc5-0541-4428-9601-5610616cd52a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.197893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.198501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.198778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.199046 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.199661 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:10.199958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.203151 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.203350 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d520f34-ba2a-49ad-9f73-e960848923b0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.210595 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 349/700] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:10.210595 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.236770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea706e-8e3d-47a5-a6a6-d36965ff57b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.237685 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea706e-8e3d-47a5-a6a6-d36965ff57b0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.237958 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea706e-8e3d-47a5-a6a6-d36965ff57b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.238299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea706e-8e3d-47a5-a6a6-d36965ff57b0 None admin] PATH_INFO: `/v3/services/network` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.238868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea706e-8e3d-47a5-a6a6-d36965ff57b0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.240223 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea706e-8e3d-47a5-a6a6-d36965ff57b0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-67ea706e-8e3d-47a5-a6a6-d36965ff57b0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:10.248705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:10.249857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:10.250698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 352/701] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/services/network => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:10.251673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734891ae-d182-4604-8c49-bd983123d2b4 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.251673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734891ae-d182-4604-8c49-bd983123d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.252372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734891ae-d182-4604-8c49-bd983123d2b4 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.257378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 353/702] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:10.257378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734891ae-d182-4604-8c49-bd983123d2b4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.269203 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:10.318271 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ff354-ba4f-4674-a608-0ebe9f24f3ed None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.351510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.352109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.352391 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.352659 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.353277 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] RBAC: Adding query filter params (type=image) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:10.353608 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.354960 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.357632 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734891ae-d182-4604-8c49-bd983123d2b4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.359733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 350/703] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:10.362264 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.371258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:10.394032 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8480114-357c-4b53-b24d-be33119a4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.394649 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480114-357c-4b53-b24d-be33119a4336 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.394935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480114-357c-4b53-b24d-be33119a4336 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.395211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480114-357c-4b53-b24d-be33119a4336 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.395833 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8480114-357c-4b53-b24d-be33119a4336 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:10.396136 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8480114-357c-4b53-b24d-be33119a4336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.397544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8480114-357c-4b53-b24d-be33119a4336 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.402190 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 354/704] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:10.403366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548bf5-2a9a-4a4b-b04b-b901e47eb2e4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.403598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548bf5-2a9a-4a4b-b04b-b901e47eb2e4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.403880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548bf5-2a9a-4a4b-b04b-b901e47eb2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.421191 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c3548bf5-2a9a-4a4b-b04b-b901e47eb2e4 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:10.422414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c3548bf5-2a9a-4a4b-b04b-b901e47eb2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:10.470455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948b1db-5988-4a5c-9226-b52487f3caa4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.488420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 355/705] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:10.489589 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3548bf5-2a9a-4a4b-b04b-b901e47eb2e4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.490577 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:10.508502 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.509122 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.509436 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.509718 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.510346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] RBAC: Adding query filter params (name=network) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:10.510654 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.512030 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.522429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 351/706] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:10.522429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.608582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3548bf5-2a9a-4a4b-b04b-b901e47eb2e4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.617637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:10.632981 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab52f-9ed4-4a8a-90c5-8ce23b45a13e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.646287 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.646901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.647181 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.647451 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.648144 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] RBAC: Adding query filter params (interface=public, service_id=3351d2f832e943feb0c28a6328073e90, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:10.648448 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.649857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.657391 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 356/707] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/endpoints?service_id=3351d2f832e943feb0c28a6328073e90&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:10.658556 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.676053 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.677292 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.677817 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.678600 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.679488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] RBAC: Adding query filter params (interface=public, service_id=ebf9e4a2c018468aa2862ca74f72ad17, region_id=RegionOne) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:10.680007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.682119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.699488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 352/708] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/endpoints?service_id=ebf9e4a2c018468aa2862ca74f72ad17&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:10.699488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.761891 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:10.772304 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2732c3-62a7-4233-9da5-00681f3560e4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.808676 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.810039 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.810039 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.810039 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.811399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] RBAC: Adding query filter params (type=network) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:10.811716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.813083 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.818014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 357/709] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:10.820202 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc4510-3c1b-462f-ac85-22b79b61c176 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.820332 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.852112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:10.853575 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee9d00-7f5c-4acc-a7be-a77ee6609f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.854259 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9d00-7f5c-4acc-a7be-a77ee6609f28 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.854539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9d00-7f5c-4acc-a7be-a77ee6609f28 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.854997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9d00-7f5c-4acc-a7be-a77ee6609f28 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.855510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee9d00-7f5c-4acc-a7be-a77ee6609f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.856908 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee9d00-7f5c-4acc-a7be-a77ee6609f28 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.862961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 353/710] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/services => generated 1002 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:15:10.863744 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee9d00-7f5c-4acc-a7be-a77ee6609f28 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.927396 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea5ca-8ce6-4795-8506-d899ff4db960 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:10.964748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a735e-e860-4307-9f86-f724bd6a3e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:10.965405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a735e-e860-4307-9f86-f724bd6a3e35 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:10.965693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a735e-e860-4307-9f86-f724bd6a3e35 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:10.965971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a735e-e860-4307-9f86-f724bd6a3e35 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:10.966580 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a735e-e860-4307-9f86-f724bd6a3e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:10.967986 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a735e-e860-4307-9f86-f724bd6a3e35 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:10.974395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 358/711] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/services => generated 1002 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:15:10.975264 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a735e-e860-4307-9f86-f724bd6a3e35 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:10.994334 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee9d00-7f5c-4acc-a7be-a77ee6609f28 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:11.013722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:11.050038 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed82629-d4ef-4d24-9938-cfe3cc9d0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:11.050862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed82629-d4ef-4d24-9938-cfe3cc9d0b19 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.051411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed82629-d4ef-4d24-9938-cfe3cc9d0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.051759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed82629-d4ef-4d24-9938-cfe3cc9d0b19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.067790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed82629-d4ef-4d24-9938-cfe3cc9d0b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-2ed82629-d4ef-4d24-9938-cfe3cc9d0b19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:15:11.075172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:11.076396 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:15:11.077283 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:11.078265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 354/712] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:11.084237 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed82629-d4ef-4d24-9938-cfe3cc9d0b19 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:11.121911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a735e-e860-4307-9f86-f724bd6a3e35 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:11.134296 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:11.162284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:11.163074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.163469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.163868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.164699 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] RBAC: Adding query filter params (interface=public, service_id=e1a7b77954fc46a894c9da8bde842b52, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:11.165122 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:11.166672 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:11.172998 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 359/713] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Sep 14 15:15:10 2022] GET /identity/v3/endpoints?service_id=e1a7b77954fc46a894c9da8bde842b52&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:11.179697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:11.202360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed82629-d4ef-4d24-9938-cfe3cc9d0b19 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:11.242364 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:11.242978 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.243268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.243542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.245483 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:11.245483 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:11.245943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:11.258096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 355/714] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:11.269356 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:11.310795 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef49d8e-2913-4a30-888e-8c7deeb9dbe5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:11.316874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:11.358481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3b3d-46be-4f63-bff4-589dd1b84478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:11.359219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3b3d-46be-4f63-bff4-589dd1b84478 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.359846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3b3d-46be-4f63-bff4-589dd1b84478 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.360128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3b3d-46be-4f63-bff4-589dd1b84478 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.360733 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3b3d-46be-4f63-bff4-589dd1b84478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:11.362341 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3b3d-46be-4f63-bff4-589dd1b84478 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:11.368312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 360/715] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Sep 14 15:15:11 2022] GET /identity/v3/services => generated 1002 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:15:11.413571 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd40b8-cca2-4184-8c4e-d98e621fe3d1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:11.457522 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:11.458148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.458431 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.458705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.471009 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:11.472493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:11.490433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:11.491501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:11.492417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:11.492417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:11.492417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:11.492417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 356/716] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:11.498029 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3b3d-46be-4f63-bff4-589dd1b84478 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:11.536376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:11.622630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3b3d-46be-4f63-bff4-589dd1b84478 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:11.659364 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:11.660263 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.660704 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.661142 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.661961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:11.662415 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:11.663962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:11.677616 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 361/717] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:11.685440 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:11.777957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:11.793343 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d318d92-bfac-4cb2-ae4e-97e81a0fc93c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:11.829724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:11.830366 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:11.830643 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:11.830914 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:11.838625 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:11.840156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:11.851224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:11.852158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:11.853138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 357/718] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Sep 14 15:15:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:11.858193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:11.953377 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:11.971532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889044ab-1512-4265-b42a-391678e3c5f2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.008577 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.009189 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.009504 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.009779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.010508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:12.010814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.012246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.030587 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 362/719] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Sep 14 15:15:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:12.036910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.143794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d930d-caa2-4ff8-ad71-4733f33cc560 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.179695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa259d7-0291-4e64-bbe6-42102ceda226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.180306 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa259d7-0291-4e64-bbe6-42102ceda226 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.180584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa259d7-0291-4e64-bbe6-42102ceda226 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.180854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa259d7-0291-4e64-bbe6-42102ceda226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.197018 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:12.260787 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa259d7-0291-4e64-bbe6-42102ceda226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.262354 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa259d7-0291-4e64-bbe6-42102ceda226 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.368075 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 358/720] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:15:12.373577 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.489483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f32f49-58fe-4e6a-b00a-317d63489078 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.535575 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.536220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.536502 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.536778 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.547638 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.549115 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.551658 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:12.566096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:12.567128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:12.568049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:12.568049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:12.568049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:12.568049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 363/721] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:12.572905 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa259d7-0291-4e64-bbe6-42102ceda226 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.620853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:12.677675 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa259d7-0291-4e64-bbe6-42102ceda226 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.712652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.713261 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.713571 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.713845 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.714487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:12.714787 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.716156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.728638 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 359/722] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:12.733870 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:12.844536 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dd72c-0281-41f7-a604-dc23c9f58c85 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:12.881004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:12.881677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:12.881961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:12.882239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:12.889479 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:12.890948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:12.903793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:12.905879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:12.908022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 364/723] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:12.911459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:13.017456 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b107d2-2f8a-4988-95fb-7e3cc9895fe7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:13.025167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:13.059044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ee79c-93f8-4fa0-8427-9e2c4e3e80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:13.059671 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee79c-93f8-4fa0-8427-9e2c4e3e80f2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.059951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee79c-93f8-4fa0-8427-9e2c4e3e80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.060221 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee79c-93f8-4fa0-8427-9e2c4e3e80f2 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.060935 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ee79c-93f8-4fa0-8427-9e2c4e3e80f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:13.061239 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ee79c-93f8-4fa0-8427-9e2c4e3e80f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:13.062860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ee79c-93f8-4fa0-8427-9e2c4e3e80f2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:13.078129 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 360/724] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:13.085189 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:13.148037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:13.198329 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918126d8-fb56-462b-82ad-87221ae005ab None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:13.234753 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f4dbb-aa58-4249-88d8-86b753765dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:13.235362 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f4dbb-aa58-4249-88d8-86b753765dad None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.235642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f4dbb-aa58-4249-88d8-86b753765dad None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.236471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f4dbb-aa58-4249-88d8-86b753765dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.237196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f4dbb-aa58-4249-88d8-86b753765dad None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=7eb7034159904b73bcfc7b150843be48) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:13.237531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f4dbb-aa58-4249-88d8-86b753765dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:13.238960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f4dbb-aa58-4249-88d8-86b753765dad None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:13.245470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 365/725] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:15:13 2022] GET /identity/v3/role_assignments?user.id=7eb7034159904b73bcfc7b150843be48&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=6211512533b744e8b1ee9031113654ac => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:13.487932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82705c-2712-4a4f-82dc-caf8f4b65240 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.488250 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82705c-2712-4a4f-82dc-caf8f4b65240 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.488412 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82705c-2712-4a4f-82dc-caf8f4b65240 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.490128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 361/726] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:13.496018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16a37-e64d-4c15-8435-97ff2c6b0669 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.496641 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16a37-e64d-4c15-8435-97ff2c6b0669 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.496641 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16a37-e64d-4c15-8435-97ff2c6b0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.519346 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-60f16a37-e64d-4c15-8435-97ff2c6b0669 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:13.520556 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-60f16a37-e64d-4c15-8435-97ff2c6b0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:13.583089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa9120-492f-42bb-8683-cfa7a4ed7a92 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.583089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa9120-492f-42bb-8683-cfa7a4ed7a92 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.583089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa9120-492f-42bb-8683-cfa7a4ed7a92 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.584226 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 362/727] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:15:13.589306 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c32fc-fcd8-47f2-aaa3-5da548c9940c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.590093 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c32fc-fcd8-47f2-aaa3-5da548c9940c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.590382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c32fc-fcd8-47f2-aaa3-5da548c9940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.601347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 366/728] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:13.611847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-374c32fc-fcd8-47f2-aaa3-5da548c9940c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:13.613056 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-374c32fc-fcd8-47f2-aaa3-5da548c9940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:13.692242 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 363/729] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:15:13.936366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f415-448b-4d4f-b005-427b8d3a68cb None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.937094 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f415-448b-4d4f-b005-427b8d3a68cb None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.937628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f415-448b-4d4f-b005-427b8d3a68cb None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.939498 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 367/730] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:13.943961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c32fc-fcd8-47f2-aaa3-5da548c9940c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:13.944935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e19f-2706-44de-9c29-cbe770b4d39e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:13.945492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e19f-2706-44de-9c29-cbe770b4d39e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:13.945976 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e19f-2706-44de-9c29-cbe770b4d39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:13.964543 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8539e19f-2706-44de-9c29-cbe770b4d39e None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:13.966076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8539e19f-2706-44de-9c29-cbe770b4d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:14.019246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:14.045394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 368/731] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:15:14.045394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e19f-2706-44de-9c29-cbe770b4d39e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.064831 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:14.073158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c32fc-fcd8-47f2-aaa3-5da548c9940c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.123969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.124732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.125158 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.125551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] PATH_INFO: `/v3/services/image` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.126190 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.127659 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:14.140413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:14.141636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:14.143051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 364/732] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Sep 14 15:15:13 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:14.148263 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.164912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e19f-2706-44de-9c29-cbe770b4d39e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.210118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.210673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.211091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.211374 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.211950 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.213967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:14.225852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:14.227074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:14.228077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 369/733] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Sep 14 15:15:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:14.232663 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.265673 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a552b02-1ddf-47b1-8247-0af065e496ba None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.288274 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:14.306762 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.307373 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.307651 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.307916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.308535 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] RBAC: Adding query filter params (name=image) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:14.308832 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.310266 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.315453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 365/734] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:14.320933 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.348963 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:14.370219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93ea6b-5f3d-49a0-b3cc-00030cd33994 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.414215 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.415206 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.415735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.416014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.416659 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:14.416966 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.418429 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.424252 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 370/735] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Sep 14 15:15:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:14.429600 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.432040 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183c9e4-6426-47ca-85f0-7cbaa4c23ef9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.469670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.470195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.471178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.471178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.471664 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] RBAC: Adding query filter params (type=image) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:14.471967 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.473354 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.478753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 366/736] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:14.479558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.538442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291afd1-0d9c-4b1f-911c-76d86fbc6b8e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.547430 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:14.578241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.578879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.579164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.579442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] PATH_INFO: `/v3/services/network` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.580592 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.581999 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.583155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:14.591680 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:14.597601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:14.598719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 371/737] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:14 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:14.599717 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.605632 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e8504-dedb-486d-a4ee-085cbfdcf366 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.642824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.643437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.643713 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.643992 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.644656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:14.644961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.646370 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.651285 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 367/738] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Sep 14 15:15:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:14.651894 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.702454 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c363c8-53cf-4192-bfcb-560f476e7d95 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.742327 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bfa02-87d6-4d6c-a10a-2c5aa481b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.743288 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bfa02-87d6-4d6c-a10a-2c5aa481b9e6 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.743983 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bfa02-87d6-4d6c-a10a-2c5aa481b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.744417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bfa02-87d6-4d6c-a10a-2c5aa481b9e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.745245 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bfa02-87d6-4d6c-a10a-2c5aa481b9e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.747202 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bfa02-87d6-4d6c-a10a-2c5aa481b9e6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.758853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c98dc-dbc1-4f3e-a1de-c92d7a8c9e2a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.775637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 372/739] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:15:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:14.776730 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bfa02-87d6-4d6c-a10a-2c5aa481b9e6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.811701 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:14.812641 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:14.813019 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:14.813456 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:14.814272 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] RBAC: Adding query filter params (name=network) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:14.815212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:14.816864 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:14.827609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 368/740] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:14.829246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:14.848554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:14.959880 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde363c-d5a2-4604-84b9-2e46c67979bd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:14.970747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:14.999790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:15.000759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:15.001044 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:15.001342 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:15.002617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] RBAC: Adding query filter params (type=network) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:15.002926 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:15.004359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:15.010645 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 369/741] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:15.016865 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:15.062852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bfa02-87d6-4d6c-a10a-2c5aa481b9e6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:15.105440 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb0b9a-5615-456d-9b4d-406b58fec332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:15.106068 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb0b9a-5615-456d-9b4d-406b58fec332 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:15.106357 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb0b9a-5615-456d-9b4d-406b58fec332 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:15.106643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb0b9a-5615-456d-9b4d-406b58fec332 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:15.107311 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb0b9a-5615-456d-9b4d-406b58fec332 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:15.108696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb0b9a-5615-456d-9b4d-406b58fec332 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:15.113285 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:15.138625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 373/742] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:15:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:15.139905 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee689c-c2a8-44a2-ac29-023741ab64e3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:15.193557 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422622a1-5812-4c3b-959d-2429084ef1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:15.194229 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422622a1-5812-4c3b-959d-2429084ef1b8 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:15.194517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422622a1-5812-4c3b-959d-2429084ef1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:15.194794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422622a1-5812-4c3b-959d-2429084ef1b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:15.195471 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422622a1-5812-4c3b-959d-2429084ef1b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:15.196864 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422622a1-5812-4c3b-959d-2429084ef1b8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:15.229367 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 370/743] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:15:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:15.782395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbfebd-667c-4aa3-b5bb-d0947fb7b918 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:15.782987 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbfebd-667c-4aa3-b5bb-d0947fb7b918 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:15.782987 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbfebd-667c-4aa3-b5bb-d0947fb7b918 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:15.784522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 374/744] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:15.789534 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a348d6-3f90-41b7-aef0-aca2550abb5f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:15.789925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a348d6-3f90-41b7-aef0-aca2550abb5f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:15.790103 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a348d6-3f90-41b7-aef0-aca2550abb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:15.809031 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e0a348d6-3f90-41b7-aef0-aca2550abb5f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:15.810238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e0a348d6-3f90-41b7-aef0-aca2550abb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:15.882405 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 371/745] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:15 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:16.202757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbfebd-667c-4aa3-b5bb-d0947fb7b918 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:16.290181 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:16.316760 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbfebd-667c-4aa3-b5bb-d0947fb7b918 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:16.356444 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:16.356444 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:16.356444 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:16.356444 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:16.356891 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:16.357381 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:16.367312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:16.368319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:16.369306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:16.370887 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 375/746] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Sep 14 15:15:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:16.374253 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a348d6-3f90-41b7-aef0-aca2550abb5f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:16.433241 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:16.480328 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a348d6-3f90-41b7-aef0-aca2550abb5f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:16.515222 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65323a80-420c-4da9-a92c-9eaa92bb715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:16.515828 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65323a80-420c-4da9-a92c-9eaa92bb715b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:16.516106 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65323a80-420c-4da9-a92c-9eaa92bb715b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:16.516533 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65323a80-420c-4da9-a92c-9eaa92bb715b None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:16.517216 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65323a80-420c-4da9-a92c-9eaa92bb715b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:16.517566 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65323a80-420c-4da9-a92c-9eaa92bb715b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:16.518938 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65323a80-420c-4da9-a92c-9eaa92bb715b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:16.523772 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 372/747] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Sep 14 15:15:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:16.529777 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:16.640363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc018dd-7363-42a9-b6ce-409cb183c07c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:16.675657 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285f7ae-eea9-4dc7-a619-a9ee8e80c6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:16.676273 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285f7ae-eea9-4dc7-a619-a9ee8e80c6fe None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:16.676558 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285f7ae-eea9-4dc7-a619-a9ee8e80c6fe None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:16.676832 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285f7ae-eea9-4dc7-a619-a9ee8e80c6fe None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:16.677499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285f7ae-eea9-4dc7-a619-a9ee8e80c6fe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:16.677806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285f7ae-eea9-4dc7-a619-a9ee8e80c6fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:16.679181 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285f7ae-eea9-4dc7-a619-a9ee8e80c6fe None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:16.685379 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 376/748] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Sep 14 15:15:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:17.320686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33afa-fdc9-4624-aff4-f90c24958023 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.321228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33afa-fdc9-4624-aff4-f90c24958023 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.321228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33afa-fdc9-4624-aff4-f90c24958023 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.322774 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 373/749] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:17.328471 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f34e9-4b51-42e5-87c9-1584790359cb None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.329003 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f34e9-4b51-42e5-87c9-1584790359cb None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.329003 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f34e9-4b51-42e5-87c9-1584790359cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.347766 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f91f34e9-4b51-42e5-87c9-1584790359cb None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:17.348937 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f91f34e9-4b51-42e5-87c9-1584790359cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:17.356594 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:17.418627 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 377/750] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:17 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:17.737068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c33afa-fdc9-4624-aff4-f90c24958023 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:17.771025 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726eb15-bcc5-4caa-8254-45cb77ba34b1 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.771308 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726eb15-bcc5-4caa-8254-45cb77ba34b1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.771615 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726eb15-bcc5-4caa-8254-45cb77ba34b1 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.772948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 378/751] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:17.777918 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be9625-059b-4f36-ac93-b078dcef7310 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.778313 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be9625-059b-4f36-ac93-b078dcef7310 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.778585 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be9625-059b-4f36-ac93-b078dcef7310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.797454 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f2be9625-059b-4f36-ac93-b078dcef7310 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:17.798631 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f2be9625-059b-4f36-ac93-b078dcef7310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:17.853097 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c33afa-fdc9-4624-aff4-f90c24958023 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:17.871775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 379/752] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:17 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:17.873580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:17.891794 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c24c57-ea7d-40a0-a097-2cd64b4c8768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:17.892975 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24c57-ea7d-40a0-a097-2cd64b4c8768 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:17.893262 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24c57-ea7d-40a0-a097-2cd64b4c8768 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:17.893565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24c57-ea7d-40a0-a097-2cd64b4c8768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:17.963435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c24c57-ea7d-40a0-a097-2cd64b4c8768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:17.964885 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c24c57-ea7d-40a0-a097-2cd64b4c8768 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.069435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 374/753] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:15:17 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:15:18.071347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be9625-059b-4f36-ac93-b078dcef7310 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.144751 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:18.176476 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be9625-059b-4f36-ac93-b078dcef7310 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.192569 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c24c57-ea7d-40a0-a097-2cd64b4c8768 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.212443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:18.214622 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.215786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.215961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.216187 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.226582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.228026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:15:18.242371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:18.243417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:15:18.244322 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:15:18.244322 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:15:18.244322 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:18.244322 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 380/754] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:18.249156 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.315206 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c24c57-ea7d-40a0-a097-2cd64b4c8768 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.355020 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d983890-8482-4a4e-9174-e37a57962d8a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.355580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.355947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.355947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.356292 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.357054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.359329 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:18.371525 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:18.372547 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:18.373803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:18.378866 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 375/755] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:15:18.379736 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.381419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:18.392780 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.393419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.393698 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.393966 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.394597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:18.394895 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.396252 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.408690 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 381/756] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:18.615723 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:18.638993 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979bcb6-bca2-413c-86ec-072913e6ecd1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.677464 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabada2c-ca12-4cc2-b049-42af556869d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.678102 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabada2c-ca12-4cc2-b049-42af556869d9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.678415 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabada2c-ca12-4cc2-b049-42af556869d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.678664 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabada2c-ca12-4cc2-b049-42af556869d9 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.679320 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabada2c-ca12-4cc2-b049-42af556869d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:18.679620 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabada2c-ca12-4cc2-b049-42af556869d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.681040 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabada2c-ca12-4cc2-b049-42af556869d9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.686801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 376/757] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:18.693112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:18.803660 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5b6ea-b467-402f-8a22-2b45b4a583cd None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:18.837210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368a675-3f16-446c-90e8-650238f3daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:18.837857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a675-3f16-446c-90e8-650238f3daa7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:18.838140 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a675-3f16-446c-90e8-650238f3daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:18.838412 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a675-3f16-446c-90e8-650238f3daa7 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:18.839035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368a675-3f16-446c-90e8-650238f3daa7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:18.839337 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368a675-3f16-446c-90e8-650238f3daa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:18.840692 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368a675-3f16-446c-90e8-650238f3daa7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:18.844997 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 382/758] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:19.114930 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba800ec-709a-492e-a912-3ccf4dfe7189 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:19.115221 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba800ec-709a-492e-a912-3ccf4dfe7189 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:19.115495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba800ec-709a-492e-a912-3ccf4dfe7189 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:19.116813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 377/759] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:19.122117 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aefdf-114e-40d4-adc3-fb60b02fac2a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:19.122401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aefdf-114e-40d4-adc3-fb60b02fac2a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:19.122669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aefdf-114e-40d4-adc3-fb60b02fac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:19.140782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6f7aefdf-114e-40d4-adc3-fb60b02fac2a None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:19.141976 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6f7aefdf-114e-40d4-adc3-fb60b02fac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:19.187117 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:19.211487 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 383/760] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:19 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:19.532136 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba800ec-709a-492e-a912-3ccf4dfe7189 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:19.634497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba800ec-709a-492e-a912-3ccf4dfe7189 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:19.667739 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be0a82-b881-415a-9c2c-dd0300e51b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:19.668344 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be0a82-b881-415a-9c2c-dd0300e51b41 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:19.668626 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be0a82-b881-415a-9c2c-dd0300e51b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:19.668899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be0a82-b881-415a-9c2c-dd0300e51b41 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:19.669577 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be0a82-b881-415a-9c2c-dd0300e51b41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:19.670931 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be0a82-b881-415a-9c2c-dd0300e51b41 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:19.684899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 378/761] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:15:19 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:21.190704 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0457e6-c796-4e54-8040-3bef99938d80 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:21.191243 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0457e6-c796-4e54-8040-3bef99938d80 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:21.191243 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0457e6-c796-4e54-8040-3bef99938d80 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:21.192559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 384/762] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:21.197998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030099f5-105c-4b6c-ac7e-1e461aee8e27 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:21.198399 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030099f5-105c-4b6c-ac7e-1e461aee8e27 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:21.198546 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030099f5-105c-4b6c-ac7e-1e461aee8e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:21.212347 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:21.218251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-030099f5-105c-4b6c-ac7e-1e461aee8e27 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:21.220351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-030099f5-105c-4b6c-ac7e-1e461aee8e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:21.295347 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 379/763] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:21 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:21.614987 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0457e6-c796-4e54-8040-3bef99938d80 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:21.721793 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0457e6-c796-4e54-8040-3bef99938d80 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:21.755636 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc279e-9da8-49c2-a4f4-7f09d172ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:21.756242 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc279e-9da8-49c2-a4f4-7f09d172ffc7 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:21.756518 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc279e-9da8-49c2-a4f4-7f09d172ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:21.756789 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc279e-9da8-49c2-a4f4-7f09d172ffc7 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:21.757463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc279e-9da8-49c2-a4f4-7f09d172ffc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:21.758826 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc279e-9da8-49c2-a4f4-7f09d172ffc7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:21.773891 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 385/764] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:15:21 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:22.072501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866becb7-96ff-4ffc-9bb3-949e6034ecb3 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.072711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866becb7-96ff-4ffc-9bb3-949e6034ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.072995 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866becb7-96ff-4ffc-9bb3-949e6034ecb3 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.074364 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 380/765] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:22.080240 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ca05f-0434-4c42-9301-85b2539479ca None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.080546 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ca05f-0434-4c42-9301-85b2539479ca None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.080825 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ca05f-0434-4c42-9301-85b2539479ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.099653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-786ca05f-0434-4c42-9301-85b2539479ca None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:22.100839 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-786ca05f-0434-4c42-9301-85b2539479ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:22.131787 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:22.174117 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 386/766] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:22 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:22.491304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866becb7-96ff-4ffc-9bb3-949e6034ecb3 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.591154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866becb7-96ff-4ffc-9bb3-949e6034ecb3 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.620188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:22.625647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441e020-ca72-4646-b175-05927780722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.626274 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441e020-ca72-4646-b175-05927780722b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.626599 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441e020-ca72-4646-b175-05927780722b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.626877 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441e020-ca72-4646-b175-05927780722b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.627459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441e020-ca72-4646-b175-05927780722b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:22.628823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441e020-ca72-4646-b175-05927780722b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-2441e020-ca72-4646-b175-05927780722b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:22.637796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:22.638802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:22.639697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 381/767] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:22.644809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ca05f-0434-4c42-9301-85b2539479ca None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.741289 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ca05f-0434-4c42-9301-85b2539479ca None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.774197 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.774749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.775030 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.775306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.775928 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:22.776232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:22.777624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:22.782141 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 387/768] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:22.788259 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441e020-ca72-4646-b175-05927780722b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.887927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441e020-ca72-4646-b175-05927780722b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:22.921813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:22.922589 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:22.922874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:22.923149 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:22.923776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:22.924078 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:22.925466 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:22.930327 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 382/769] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:22.936092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:22.964414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:23.037518 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fb4d4-c1f5-4dfa-850d-43acd649842f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:23.070456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06ce2-1343-4732-b969-0ab2c8468802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:23.071076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06ce2-1343-4732-b969-0ab2c8468802 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:23.071336 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06ce2-1343-4732-b969-0ab2c8468802 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:23.071603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06ce2-1343-4732-b969-0ab2c8468802 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:23.072297 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06ce2-1343-4732-b969-0ab2c8468802 None admin] RBAC: Adding query filter params (interface=public, service_id=16c8faf390bb4b06b1e1e6dab0784989, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:23.072603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06ce2-1343-4732-b969-0ab2c8468802 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:23.073989 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06ce2-1343-4732-b969-0ab2c8468802 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:23.078924 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 388/770] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Sep 14 15:15:22 2022] GET /identity/v3/endpoints?service_id=16c8faf390bb4b06b1e1e6dab0784989&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:23.085069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:23.143245 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:23.183358 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9360e0-d6cb-4cc2-ac0a-764b6bc7fa83 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:23.219687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463a8c-f34c-4e14-870a-bae62ac5834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:23.220888 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463a8c-f34c-4e14-870a-bae62ac5834b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:23.221179 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463a8c-f34c-4e14-870a-bae62ac5834b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:23.221487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463a8c-f34c-4e14-870a-bae62ac5834b None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:23.222089 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf463a8c-f34c-4e14-870a-bae62ac5834b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:23.223451 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf463a8c-f34c-4e14-870a-bae62ac5834b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:23.229299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 383/771] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Sep 14 15:15:23 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:15:24.201694 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3584-141b-4c7b-8bb6-80d0963f354b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:24.202285 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3584-141b-4c7b-8bb6-80d0963f354b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:24.202285 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3584-141b-4c7b-8bb6-80d0963f354b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:24.203578 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 389/772] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:24.208937 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba6ec8-a731-4ef7-ae75-9b111d80febc None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:24.209398 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba6ec8-a731-4ef7-ae75-9b111d80febc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:24.209524 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba6ec8-a731-4ef7-ae75-9b111d80febc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:24.228224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-45ba6ec8-a731-4ef7-ae75-9b111d80febc None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:24.229431 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-45ba6ec8-a731-4ef7-ae75-9b111d80febc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:24.295183 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 384/773] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:24 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:24.621904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d3584-141b-4c7b-8bb6-80d0963f354b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:24.712327 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:24.723525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d3584-141b-4c7b-8bb6-80d0963f354b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:24.756923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:24.757574 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:24.757853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:24.758124 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:24.758687 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:24.760035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:24.770171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:24.771384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:24.772249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 390/774] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:24.777145 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba6ec8-a731-4ef7-ae75-9b111d80febc None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:24.829196 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:24.874572 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba6ec8-a731-4ef7-ae75-9b111d80febc None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:24.909040 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:24.909658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:24.909935 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:24.910210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:24.910833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:24.911125 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:24.912471 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:24.916881 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 385/775] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:24.922766 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:25.023695 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbc86-4a86-459f-8331-a5a5fa385496 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:25.056534 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:25.057144 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:25.057456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:25.057732 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:25.058359 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:25.058662 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:25.060024 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:25.065613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 391/776] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:25.071297 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:25.170104 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26258-2134-4d6b-bf0f-3408fa78c159 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:25.190469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:25.209377 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0f8b5-019e-442a-b0dd-700991185715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:25.210025 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f8b5-019e-442a-b0dd-700991185715 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:25.210258 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f8b5-019e-442a-b0dd-700991185715 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:25.210526 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0f8b5-019e-442a-b0dd-700991185715 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:25.211225 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0f8b5-019e-442a-b0dd-700991185715 None admin] RBAC: Adding query filter params (interface=public, service_id=c433b2ae58c643aa9198981a71ac8b5e, region_id=RegionOne) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:25.211532 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0f8b5-019e-442a-b0dd-700991185715 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:25.212890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0f8b5-019e-442a-b0dd-700991185715 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:25.218026 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 386/777] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Sep 14 15:15:25 2022] GET /identity/v3/endpoints?service_id=c433b2ae58c643aa9198981a71ac8b5e&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:25.223837 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:25.246467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:25.329718 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763dd2-d026-4b55-a67a-cf9472b8e00c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:25.363198 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832a80-e236-4f97-8447-81427d715140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:25.363807 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832a80-e236-4f97-8447-81427d715140 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:25.364088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832a80-e236-4f97-8447-81427d715140 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:25.364362 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832a80-e236-4f97-8447-81427d715140 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:25.364961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa832a80-e236-4f97-8447-81427d715140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:25.366396 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa832a80-e236-4f97-8447-81427d715140 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:25.372109 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 392/778] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Sep 14 15:15:25 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:15:25.616144 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa4f9-2d9a-426b-9aef-73f55fda58ed None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:25.616429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa4f9-2d9a-426b-9aef-73f55fda58ed None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:25.616698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa4f9-2d9a-426b-9aef-73f55fda58ed None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:25.618067 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 387/779] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:25.623125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f34e83-5106-4e87-890b-af14bf7941c2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:25.623416 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f34e83-5106-4e87-890b-af14bf7941c2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:25.623691 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f34e83-5106-4e87-890b-af14bf7941c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:25.643520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a3f34e83-5106-4e87-890b-af14bf7941c2 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:25.644683 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a3f34e83-5106-4e87-890b-af14bf7941c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:25.712434 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 393/780] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:25 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:26.034343 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fa4f9-2d9a-426b-9aef-73f55fda58ed None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:26.135556 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fa4f9-2d9a-426b-9aef-73f55fda58ed None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:26.168261 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:26.168876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.169152 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.169448 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.170015 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:26.171369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:26.181369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:26.182517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:26.183527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 388/781] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Sep 14 15:15:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:26.188401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f34e83-5106-4e87-890b-af14bf7941c2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:26.203362 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:26.289946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f34e83-5106-4e87-890b-af14bf7941c2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:26.326310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:26.326918 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.327191 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.327460 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.328344 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:26.328684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:26.330205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:26.336670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 394/782] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Sep 14 15:15:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:26.342313 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:26.393367 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:26.448130 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d6648-5113-49fb-a0bc-dad1c1738260 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:26.481143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf08dbc-9593-4c31-bc45-694492a769d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:26.481786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08dbc-9593-4c31-bc45-694492a769d6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.482068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08dbc-9593-4c31-bc45-694492a769d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.482343 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08dbc-9593-4c31-bc45-694492a769d6 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.482987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08dbc-9593-4c31-bc45-694492a769d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:26.483275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08dbc-9593-4c31-bc45-694492a769d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:26.484635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08dbc-9593-4c31-bc45-694492a769d6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:26.489957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 389/783] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Sep 14 15:15:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:26.495607 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:26.573571 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:26.596696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ddf9-2f4a-41ca-a8c5-282d0e96b3aa None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:26.630852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914915-01ff-4080-99f7-87b2b826cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:26.631454 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914915-01ff-4080-99f7-87b2b826cb24 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:26.631729 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914915-01ff-4080-99f7-87b2b826cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:26.631997 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914915-01ff-4080-99f7-87b2b826cb24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:26.632641 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914915-01ff-4080-99f7-87b2b826cb24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:26.634018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914915-01ff-4080-99f7-87b2b826cb24 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:26.654647 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 395/784] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:15:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:15:27.761214 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db623e1a-b96c-4649-b1aa-da5c603e40dd None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:27.761811 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db623e1a-b96c-4649-b1aa-da5c603e40dd None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:27.761811 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db623e1a-b96c-4649-b1aa-da5c603e40dd None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:27.763269 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 390/785] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:27.768566 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53caec8-15de-470c-8263-567c9841bce3 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:27.769001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53caec8-15de-470c-8263-567c9841bce3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:27.769112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53caec8-15de-470c-8263-567c9841bce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:27.787363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f53caec8-15de-470c-8263-567c9841bce3 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:27.788518 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f53caec8-15de-470c-8263-567c9841bce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:27.859466 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 396/786] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:27 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:28.178874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db623e1a-b96c-4649-b1aa-da5c603e40dd None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:28.277954 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db623e1a-b96c-4649-b1aa-da5c603e40dd None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:28.288779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:28.311713 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:28.312341 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:28.312618 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:28.312890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:28.313626 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:28.315125 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:28.323850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:28.325042 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 15:15:28.326096 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:28.329460 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 391/787] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:28.331401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53caec8-15de-470c-8263-567c9841bce3 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:28.390227 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:28.433606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53caec8-15de-470c-8263-567c9841bce3 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:28.467417 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:28.468026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:28.468309 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:28.468584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:28.469221 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:28.469555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:28.471590 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:28.476210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 397/788] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:28.481933 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:28.580696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafb3b5-2532-4ca8-95be-dc38e79ec6b1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:28.615763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61257-21f4-4df0-af03-da4b527fd2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:28.616376 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61257-21f4-4df0-af03-da4b527fd2ec None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:28.616659 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61257-21f4-4df0-af03-da4b527fd2ec None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:28.616934 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61257-21f4-4df0-af03-da4b527fd2ec None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:28.617616 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61257-21f4-4df0-af03-da4b527fd2ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:28.617919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61257-21f4-4df0-af03-da4b527fd2ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:28.619316 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61257-21f4-4df0-af03-da4b527fd2ec None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:28.624807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 392/789] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Sep 14 15:15:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:28.631796 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:28.731470 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944cd0-3fef-40f2-aaf2-d03d83f0a4d3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:28.754749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:28.765833 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469bc8-5145-41cc-8ffd-79261a8b4f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:28.766436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469bc8-5145-41cc-8ffd-79261a8b4f99 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:28.766712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469bc8-5145-41cc-8ffd-79261a8b4f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:28.766979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469bc8-5145-41cc-8ffd-79261a8b4f99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:28.768234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6469bc8-5145-41cc-8ffd-79261a8b4f99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:28.769617 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6469bc8-5145-41cc-8ffd-79261a8b4f99 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:28.788610 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 398/790] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:15:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:29.065773 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702ca4-0651-41f0-bcd9-a5d78fdc15e8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:29.066275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702ca4-0651-41f0-bcd9-a5d78fdc15e8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:29.066275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702ca4-0651-41f0-bcd9-a5d78fdc15e8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:29.067538 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 393/791] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:29.072981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa40ef-29ba-4a99-8585-bb6fa858c97e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:29.073282 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa40ef-29ba-4a99-8585-bb6fa858c97e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:29.073602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa40ef-29ba-4a99-8585-bb6fa858c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:29.092238 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-d8aa40ef-29ba-4a99-8585-bb6fa858c97e None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:29.093453 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d8aa40ef-29ba-4a99-8585-bb6fa858c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:29.165642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 399/792] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:29 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:15:29.489217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702ca4-0651-41f0-bcd9-a5d78fdc15e8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:29.529456 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:29.597188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702ca4-0651-41f0-bcd9-a5d78fdc15e8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:29.634492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:29.635113 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:29.635387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:29.635654 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:29.636251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:29.637622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:29.646592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:29.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:29.648400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 394/793] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:29.653606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa40ef-29ba-4a99-8585-bb6fa858c97e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:29.751024 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa40ef-29ba-4a99-8585-bb6fa858c97e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:29.758763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:29.788393 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f635-5dc9-4878-977f-8e5b1cfe7ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:29.789026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f635-5dc9-4878-977f-8e5b1cfe7ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:29.789255 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f635-5dc9-4878-977f-8e5b1cfe7ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:29.789571 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f635-5dc9-4878-977f-8e5b1cfe7ce2 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:29.790194 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f635-5dc9-4878-977f-8e5b1cfe7ce2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:29.790494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f635-5dc9-4878-977f-8e5b1cfe7ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:29.791860 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f635-5dc9-4878-977f-8e5b1cfe7ce2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:29.796600 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 400/794] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:29.802428 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:29.902948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26ac6d-fc5f-4011-9955-81ee765e7d49 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:29.904481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:29.939666 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c1fd7-bcc7-4452-93d9-64195e912efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:29.940272 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c1fd7-bcc7-4452-93d9-64195e912efb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:29.940551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c1fd7-bcc7-4452-93d9-64195e912efb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:29.940822 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c1fd7-bcc7-4452-93d9-64195e912efb None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:29.941480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c1fd7-bcc7-4452-93d9-64195e912efb None admin] RBAC: Adding query filter params (type=compute) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:29.941785 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c1fd7-bcc7-4452-93d9-64195e912efb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:29.943147 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c1fd7-bcc7-4452-93d9-64195e912efb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:29.947607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 395/795] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:31.177801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c71cc7-d51a-486f-89a0-33dddda095f5 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.178365 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c71cc7-d51a-486f-89a0-33dddda095f5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.178365 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c71cc7-d51a-486f-89a0-33dddda095f5 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.179908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 401/796] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:31.184927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756750-0480-4b7e-874c-856db950fc21 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.185383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756750-0480-4b7e-874c-856db950fc21 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.185522 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756750-0480-4b7e-874c-856db950fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.203502 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e3756750-0480-4b7e-874c-856db950fc21 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:31.205215 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e3756750-0480-4b7e-874c-856db950fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:31.274817 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 396/797] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:31.596933 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c71cc7-d51a-486f-89a0-33dddda095f5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:31.696742 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c71cc7-d51a-486f-89a0-33dddda095f5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:31.730455 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:31.731059 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.731335 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.731629 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.732263 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:31.733709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:31.736295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING keystone.server.flask.common [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 15:15:31.753236 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.sql.core [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 15:15:31.753236 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 15:15:31.753236 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [parameters: {'id': '7f1432b7dbd84c16807a468b56393a18', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 15:15:31.753236 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88102) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f1432b7dbd84c16807a468b56393a18.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f1432b7dbd84c16807a468b56393a18. Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:15:31.770135 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result.read() Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 14 15:15:31.771076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application yield resource Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise self.value Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application session.commit() Sep 14 15:15:31.774294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.session.flush() Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application compat.raise_( Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 15:15:31.775209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 15:15:31.776492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result.read() Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:15:31.777300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [parameters: {'id': '7f1432b7dbd84c16807a468b56393a18', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:31.778239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:31.779042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f1432b7dbd84c16807a468b56393a18. Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:31.782014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 402/798] 10.222.0.66 () {60 vars in 1140 bytes} [Wed Sep 14 15:15:31 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:31.782698 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3756750-0480-4b7e-874c-856db950fc21 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:31.870704 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:31.877772 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3756750-0480-4b7e-874c-856db950fc21 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:31.915010 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762d03-684a-43ce-900b-4b2e27a51ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:31.915656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762d03-684a-43ce-900b-4b2e27a51ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:31.915933 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762d03-684a-43ce-900b-4b2e27a51ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:31.916202 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762d03-684a-43ce-900b-4b2e27a51ae5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:31.924334 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762d03-684a-43ce-900b-4b2e27a51ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:31.925837 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762d03-684a-43ce-900b-4b2e27a51ae5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-a6762d03-684a-43ce-900b-4b2e27a51ae5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:15:31.937655 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:31.938883 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:31.940411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 397/799] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:31.945466 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:31.974620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:32.051614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006fb32-840f-4571-a0f4-a17a6dc8f5b9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:32.085174 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d2860-60dc-41ca-9d19-67f213a405d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:32.085815 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2860-60dc-41ca-9d19-67f213a405d0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.086096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2860-60dc-41ca-9d19-67f213a405d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.086369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2860-60dc-41ca-9d19-67f213a405d0 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.087034 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d2860-60dc-41ca-9d19-67f213a405d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:32.087340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d2860-60dc-41ca-9d19-67f213a405d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:32.088971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d2860-60dc-41ca-9d19-67f213a405d0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:32.108576 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 403/800] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:32.342504 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed522da-278e-4405-91b4-29049d4dcfd7 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.343007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed522da-278e-4405-91b4-29049d4dcfd7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.343114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed522da-278e-4405-91b4-29049d4dcfd7 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.344377 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 398/801] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:32.350294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acd78-f7ed-4386-91d7-630a16c3d83b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.350722 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acd78-f7ed-4386-91d7-630a16c3d83b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.350834 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acd78-f7ed-4386-91d7-630a16c3d83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.370759 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-fa9acd78-f7ed-4386-91d7-630a16c3d83b None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:32.372291 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fa9acd78-f7ed-4386-91d7-630a16c3d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:32.442335 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 404/802] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:32.763894 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed522da-278e-4405-91b4-29049d4dcfd7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:32.865419 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed522da-278e-4405-91b4-29049d4dcfd7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:32.901906 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90c6f0-306c-47ff-8061-128a578a0986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:32.902507 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90c6f0-306c-47ff-8061-128a578a0986 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:32.902789 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90c6f0-306c-47ff-8061-128a578a0986 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:32.903062 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90c6f0-306c-47ff-8061-128a578a0986 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:32.903715 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90c6f0-306c-47ff-8061-128a578a0986 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:32.905075 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90c6f0-306c-47ff-8061-128a578a0986 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:32.923318 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 399/803] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:15:32 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:34.579211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424732-20d4-47d4-9bb6-f355df2ee09e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:34.579736 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424732-20d4-47d4-9bb6-f355df2ee09e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:34.579736 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424732-20d4-47d4-9bb6-f355df2ee09e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:34.581027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 405/804] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:34.586306 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aff58-828f-4fa9-bd23-93f56c06cff8 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:34.586701 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aff58-828f-4fa9-bd23-93f56c06cff8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:34.586989 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aff58-828f-4fa9-bd23-93f56c06cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:34.605450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4b5aff58-828f-4fa9-bd23-93f56c06cff8 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:34.606635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4b5aff58-828f-4fa9-bd23-93f56c06cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:34.617733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:34.678948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 400/805] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:34 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:35.005289 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa424732-20d4-47d4-9bb6-f355df2ee09e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:35.024035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:35.108773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa424732-20d4-47d4-9bb6-f355df2ee09e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:35.143059 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5faaee-560c-45b9-b4f3-c1d798b8dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:35.143664 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5faaee-560c-45b9-b4f3-c1d798b8dbe5 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.143946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5faaee-560c-45b9-b4f3-c1d798b8dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.144218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5faaee-560c-45b9-b4f3-c1d798b8dbe5 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.144851 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5faaee-560c-45b9-b4f3-c1d798b8dbe5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:35.146317 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5faaee-560c-45b9-b4f3-c1d798b8dbe5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:35.160299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.sql.core [None req-7b5faaee-560c-45b9-b4f3-c1d798b8dbe5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 15:15:35.160299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 15:15:35.160299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [parameters: {'user_id': '1da4a32ea8784c958a57e0eaf3d6501f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 15:15:35.160299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88102) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-7b5faaee-560c-45b9-b4f3-c1d798b8dbe5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result.read() Sep 14 15:15:35.167244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:15:35.168295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application yield resource Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application next(self.gen) Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise self.value Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application session.commit() Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 15:15:35.169331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.session.flush() Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application compat.raise_( Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 15:15:35.170533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 15:15:35.171643 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application conn.query(q) Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application result.read() Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 15:15:35.172739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [parameters: {'user_id': '1da4a32ea8784c958a57e0eaf3d6501f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:35.174562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 14 15:15:35.175542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 14 15:15:35.176737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 14 15:15:35.176737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 14 15:15:35.176737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 15:15:35.176737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 15:15:35.176737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 15:15:35.176737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:35.176737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 406/806] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Sep 14 15:15:35 2022] POST /identity/v3/users => generated 160 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:35.177254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5aff58-828f-4fa9-bd23-93f56c06cff8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:35.277910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5aff58-828f-4fa9-bd23-93f56c06cff8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:35.312705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:35.313368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.313656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.313924 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.318552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdb062-dbf7-4185-b16c-a9e38ad98bde None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.318845 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdb062-dbf7-4185-b16c-a9e38ad98bde None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.319126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdb062-dbf7-4185-b16c-a9e38ad98bde None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.321825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:35.323263 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:35.323451 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 407/807] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:15:35.328369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d3bad-d234-46e2-aa23-fe998c4b9851 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.328650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d3bad-d234-46e2-aa23-fe998c4b9851 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.328921 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d3bad-d234-46e2-aa23-fe998c4b9851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:15:35.335612 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:35.336759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:35.337932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 401/808] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:15:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:35.342458 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:35.345184 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:35.348281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c04d3bad-d234-46e2-aa23-fe998c4b9851 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:35.349863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c04d3bad-d234-46e2-aa23-fe998c4b9851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:35.416430 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 408/809] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:35 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:15:35.444069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb44605-06d1-4aff-8ddf-a6129939ee15 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:35.476549 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:35.477149 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.477461 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.477736 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.478428 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:35.478731 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:35.480148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:35.514217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 402/810] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Sep 14 15:15:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:15:35.738083 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d3bad-d234-46e2-aa23-fe998c4b9851 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:35.748264 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:35.837709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d3bad-d234-46e2-aa23-fe998c4b9851 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:35.870489 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:35.871106 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:35.871384 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:35.871656 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:35.872226 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:35.873740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:35.882467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:35.883620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:15:35.884521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 409/811] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:35.889576 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:35.947119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:35.989366 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26eb05-5757-494f-9733-a9fbb5563c2d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:36.022226 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:36.022819 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:36.023097 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:36.023365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:36.023982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] RBAC: Adding query filter params (name=compute) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:36.024278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:36.025662 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:36.030166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 403/812] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:36.036094 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:36.104169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:36.135042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6bfb-b825-4cb7-9233-e919ac27b47f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:36.167920 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:36.168514 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:36.168790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:36.169058 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:36.169702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:36.170001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:36.171453 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:36.176033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 410/813] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:36.181996 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:36.278222 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a56525-ca27-4ecf-af31-6672e4e91a8a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:36.300317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:36.313243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a922-e671-445b-91ff-236fbac408c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:36.314455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a922-e671-445b-91ff-236fbac408c7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:36.314722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a922-e671-445b-91ff-236fbac408c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:36.314990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a922-e671-445b-91ff-236fbac408c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:36.315680 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a922-e671-445b-91ff-236fbac408c7 None admin] RBAC: Adding query filter params (interface=public, service_id=c97ab99636b246be844be0f4bada0973, region_id=RegionOne) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:36.315984 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a922-e671-445b-91ff-236fbac408c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:36.317358 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a922-e671-445b-91ff-236fbac408c7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:36.322253 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 404/814] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Sep 14 15:15:36 2022] GET /identity/v3/endpoints?service_id=c97ab99636b246be844be0f4bada0973&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:36.327890 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:36.429005 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93413-6ad8-4209-8ee0-6fe2d0bd3d15 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:36.461883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7e630-92ec-4705-aa88-bd8b7f7cffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:36.462484 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e630-92ec-4705-aa88-bd8b7f7cffe8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:36.462765 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e630-92ec-4705-aa88-bd8b7f7cffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:36.463063 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e630-92ec-4705-aa88-bd8b7f7cffe8 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:36.463656 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7e630-92ec-4705-aa88-bd8b7f7cffe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:36.465026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7e630-92ec-4705-aa88-bd8b7f7cffe8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:36.466748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:36.472277 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 411/815] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Sep 14 15:15:36 2022] GET /identity/v3/services => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:15:38.843322 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d97f0e-97aa-4cf8-a49d-c64d6de98bff None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:38.843899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d97f0e-97aa-4cf8-a49d-c64d6de98bff None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:38.843899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d97f0e-97aa-4cf8-a49d-c64d6de98bff None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:38.845214 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 405/816] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:15:38.850604 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449743e0-4015-4776-aaae-c729904533d1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:38.851055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449743e0-4015-4776-aaae-c729904533d1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:38.851253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449743e0-4015-4776-aaae-c729904533d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:38.870075 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-449743e0-4015-4776-aaae-c729904533d1 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:15:38.871261 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-449743e0-4015-4776-aaae-c729904533d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:15:38.943084 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 412/817] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:15:38 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:15:39.263202 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d97f0e-97aa-4cf8-a49d-c64d6de98bff None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:39.364584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d97f0e-97aa-4cf8-a49d-c64d6de98bff None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:39.397101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:39.397757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:39.398041 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:39.398317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] PATH_INFO: `/v3/services/compute` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:39.398893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:39.400253 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:15:39.409646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:15:39.410801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:15:39.411835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 406/818] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:15:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:15:39.416737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449743e0-4015-4776-aaae-c729904533d1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:39.523638 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449743e0-4015-4776-aaae-c729904533d1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:39.553893 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:39.560258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:39.560878 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:39.561161 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:39.561472 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:39.562101 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:39.562407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:39.563782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:39.568507 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 413/819] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:39.574254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:39.626703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:39.673517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65b218-0aac-4e46-9c0f-f656a478f29d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:39.706644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c280fe-8a56-4f4c-a553-e4b1d4ceb352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:39.707241 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c280fe-8a56-4f4c-a553-e4b1d4ceb352 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:39.707523 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c280fe-8a56-4f4c-a553-e4b1d4ceb352 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:39.707796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c280fe-8a56-4f4c-a553-e4b1d4ceb352 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:39.708418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c280fe-8a56-4f4c-a553-e4b1d4ceb352 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:15:39.708722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c280fe-8a56-4f4c-a553-e4b1d4ceb352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:39.710101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c280fe-8a56-4f4c-a553-e4b1d4ceb352 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:39.714769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 407/820] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Sep 14 15:15:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:15:39.721072 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:15:39.818268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301891d-fbc7-42b5-8dfa-8db05ebc0949 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:15:39.851095 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2897b-5b50-4755-94f2-a9652ec8445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:15:39.851684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2897b-5b50-4755-94f2-a9652ec8445e None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:15:39.851963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2897b-5b50-4755-94f2-a9652ec8445e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:15:39.852236 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2897b-5b50-4755-94f2-a9652ec8445e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:15:39.852901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2897b-5b50-4755-94f2-a9652ec8445e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:15:39.854295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2897b-5b50-4755-94f2-a9652ec8445e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:15:39.873490 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 414/821] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:15:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:15:49.712798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=42 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:15:49.869613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:43.369017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0770-4324-4ecb-aaf3-8cbc1f6d8cf2 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:43.369624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0770-4324-4ecb-aaf3-8cbc1f6d8cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:43.369624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d0770-4324-4ecb-aaf3-8cbc1f6d8cf2 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:43.371192 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 408/822] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:16:43.377746 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278dd8-6d4a-4709-be4f-e46ee1b438a5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:43.378242 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278dd8-6d4a-4709-be4f-e46ee1b438a5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:43.378327 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278dd8-6d4a-4709-be4f-e46ee1b438a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:43.398504 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-19278dd8-6d4a-4709-be4f-e46ee1b438a5 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:43.399940 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-19278dd8-6d4a-4709-be4f-e46ee1b438a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:43.484619 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 415/823] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:16:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:16:43.841075 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0770-4324-4ecb-aaf3-8cbc1f6d8cf2 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:43.967843 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d0770-4324-4ecb-aaf3-8cbc1f6d8cf2 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:44.011150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:44.011859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:44.012105 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:44.012363 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:44.025782 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:44.027366 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:16:44.047006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:44.048353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:16:44.049571 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:16:44.049571 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:44.049571 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:16:44.050646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 409/824] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:44.057476 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278dd8-6d4a-4709-be4f-e46ee1b438a5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:44.187093 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278dd8-6d4a-4709-be4f-e46ee1b438a5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:44.223348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:44.237056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73061a-fca6-440a-ac48-7795510650b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:44.237759 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73061a-fca6-440a-ac48-7795510650b6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:44.238043 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73061a-fca6-440a-ac48-7795510650b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:44.238345 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73061a-fca6-440a-ac48-7795510650b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:44.239060 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73061a-fca6-440a-ac48-7795510650b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:44.239371 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73061a-fca6-440a-ac48-7795510650b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:44.240869 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73061a-fca6-440a-ac48-7795510650b6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:44.255107 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 416/825] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:44.261823 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:44.342722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:44.405484 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143969-68df-4f4a-beb9-80a7ecdc1428 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:44.446892 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782fc82-6d7e-460f-943e-6fa30a4828eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:44.447462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782fc82-6d7e-460f-943e-6fa30a4828eb None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:44.447747 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782fc82-6d7e-460f-943e-6fa30a4828eb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:44.448054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782fc82-6d7e-460f-943e-6fa30a4828eb None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:44.449465 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782fc82-6d7e-460f-943e-6fa30a4828eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:44.450353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782fc82-6d7e-460f-943e-6fa30a4828eb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:44.476352 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 410/826] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Sep 14 15:16:44 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:16:47.019167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd23611-5bd0-46cd-af00-e83c10f2a0c3 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:47.019751 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd23611-5bd0-46cd-af00-e83c10f2a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:47.019751 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd23611-5bd0-46cd-af00-e83c10f2a0c3 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:47.021056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 417/827] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:16:47.026387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693b4e-b468-4126-b3be-346359407f78 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:47.026797 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693b4e-b468-4126-b3be-346359407f78 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:47.026938 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693b4e-b468-4126-b3be-346359407f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:47.046150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e1693b4e-b468-4126-b3be-346359407f78 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:47.047588 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e1693b4e-b468-4126-b3be-346359407f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:47.121209 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 411/828] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:16:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:16:47.482792 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd23611-5bd0-46cd-af00-e83c10f2a0c3 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:47.596952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd23611-5bd0-46cd-af00-e83c10f2a0c3 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:47.636782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f9da-9fac-45df-8bd4-910381837c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:47.637604 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f9da-9fac-45df-8bd4-910381837c30 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:47.637961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f9da-9fac-45df-8bd4-910381837c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:47.638239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f9da-9fac-45df-8bd4-910381837c30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:47.650234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f9da-9fac-45df-8bd4-910381837c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-d747f9da-9fac-45df-8bd4-910381837c30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:16:47.656179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:47.657407 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:47.658911 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 418/829] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:16:47.666325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1693b4e-b468-4126-b3be-346359407f78 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:47.710077 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:47.783636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1693b4e-b468-4126-b3be-346359407f78 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:47.825473 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:47.826229 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:47.826605 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:47.826947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:47.827606 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:47.827916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:47.829277 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:47.838477 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 412/830] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:47.844449 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f9da-9fac-45df-8bd4-910381837c30 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:47.898656 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:47.957851 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f9da-9fac-45df-8bd4-910381837c30 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:47.998389 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:47.999171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:47.999456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:47.999766 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:48.011955 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:48.013614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:16:48.030160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:48.033014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:16:48.034298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:16:48.034298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:48.034298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:48.034298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 419/831] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:48.037905 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:48.159063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:48.162717 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d589aac-fc5d-4355-b52c-e670fd8fc77d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:48.207625 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:48.208320 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:48.208605 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:48.208879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:48.209566 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:48.209932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:48.211278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:48.223555 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 413/832] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:16:48.229393 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:48.345088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:48.350034 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31c6fe-c4b4-4c70-abbc-9ed0e48f1823 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:48.387715 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:48.388349 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:48.388628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:48.388906 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:48.399355 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:48.399355 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:16:48.413348 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:48.414596 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:16:48.415900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:48.418166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 420/833] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:48.426036 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:48.540113 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de83fbc-5463-41e7-9bc2-76f5327abd78 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:48.576322 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:48.576935 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:48.577214 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:48.577531 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:48.578265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:48.578571 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:48.580035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:48.604214 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 414/834] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Sep 14 15:16:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:48.605246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:48.720611 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d28f3-0891-439b-a310-0714f2da6b93 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:48.760229 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf04a-6350-40f0-8cfb-e15a81131d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:48.760806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf04a-6350-40f0-8cfb-e15a81131d3a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:48.761091 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf04a-6350-40f0-8cfb-e15a81131d3a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:48.761420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf04a-6350-40f0-8cfb-e15a81131d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:48.791749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:48.835753 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf04a-6350-40f0-8cfb-e15a81131d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:48.837204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf04a-6350-40f0-8cfb-e15a81131d3a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:48.940396 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 421/835] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:16:48 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:16:48.946298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:48.966922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:49.059326 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d3eab-e2e2-4132-8280-59b66fa9a4df None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:49.098988 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:49.099651 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.100000 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.100250 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:49.111565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:49.113094 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:16:49.129165 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:49.130690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:16:49.131734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:16:49.131734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:49.131734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:16:49.135307 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 415/836] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:16:49.136314 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf04a-6350-40f0-8cfb-e15a81131d3a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:49.195525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:49.240505 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf04a-6350-40f0-8cfb-e15a81131d3a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:49.280224 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:49.280897 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.281167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.281496 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:49.282232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:49.282665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:49.284578 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:49.297453 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 422/837] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:49.303627 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:49.380192 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:49.416348 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0f40e-d884-4f1c-aacd-97379eb76470 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:49.451249 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:49.451885 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.452178 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.452450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:49.460144 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:49.461669 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:16:49.473711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:49.474775 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:16:49.475705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 416/838] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:49.480888 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:49.587177 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd647-84f8-4ff2-ba5b-3f118f8acbb2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:49.607450 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:49.626271 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514cee7-c29a-478d-b452-b488b2578835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:49.627409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514cee7-c29a-478d-b452-b488b2578835 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.627691 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514cee7-c29a-478d-b452-b488b2578835 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.627964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514cee7-c29a-478d-b452-b488b2578835 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:49.628657 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514cee7-c29a-478d-b452-b488b2578835 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:49.628964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514cee7-c29a-478d-b452-b488b2578835 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:49.630441 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514cee7-c29a-478d-b452-b488b2578835 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:49.646337 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 423/839] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:16:49.652658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:49.769210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c246-3084-49f9-9d2b-3a078c0e1bdd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:49.799876 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:49.809791 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f7983-630c-4a31-af43-0d6cf948598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:49.810949 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f7983-630c-4a31-af43-0d6cf948598e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:49.811424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f7983-630c-4a31-af43-0d6cf948598e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:49.811909 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f7983-630c-4a31-af43-0d6cf948598e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:49.813224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f7983-630c-4a31-af43-0d6cf948598e None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=55d0e3301ff94f37a05bfd75397956d0) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:49.813770 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f7983-630c-4a31-af43-0d6cf948598e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:49.817035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f7983-630c-4a31-af43-0d6cf948598e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:49.824140 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 417/840] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:16:49 2022] GET /identity/v3/role_assignments?user.id=55d0e3301ff94f37a05bfd75397956d0&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:52.475666 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38221d5-9e36-4376-8019-51ab01751204 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:52.476263 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38221d5-9e36-4376-8019-51ab01751204 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:52.476364 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38221d5-9e36-4376-8019-51ab01751204 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:52.477722 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 424/841] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:16:52.483246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275881-20b3-47d0-abef-07120e69ce15 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:52.483721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275881-20b3-47d0-abef-07120e69ce15 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:52.483856 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275881-20b3-47d0-abef-07120e69ce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:52.503039 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e5275881-20b3-47d0-abef-07120e69ce15 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:52.504317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e5275881-20b3-47d0-abef-07120e69ce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:52.574664 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 418/842] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:16:52 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:16:52.936007 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38221d5-9e36-4376-8019-51ab01751204 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:53.050613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38221d5-9e36-4376-8019-51ab01751204 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:53.086050 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fdc98-935c-4e00-87a9-a75d0358929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:53.086688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fdc98-935c-4e00-87a9-a75d0358929e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:53.087909 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fdc98-935c-4e00-87a9-a75d0358929e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:53.087909 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fdc98-935c-4e00-87a9-a75d0358929e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:53.098742 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fdc98-935c-4e00-87a9-a75d0358929e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-090fdc98-935c-4e00-87a9-a75d0358929e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:16:53.103773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:53.104904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:53.105953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 425/843] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:53.111488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275881-20b3-47d0-abef-07120e69ce15 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:53.217423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275881-20b3-47d0-abef-07120e69ce15 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:53.243511 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:53.256011 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:53.256690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:53.257050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:53.257361 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:53.258340 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:53.258643 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:53.260103 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:53.269378 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 419/844] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:16:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:53.275794 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fdc98-935c-4e00-87a9-a75d0358929e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:53.327901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:53.397325 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fdc98-935c-4e00-87a9-a75d0358929e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:53.438975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:53.439888 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:53.440202 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:53.440494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:53.453215 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:53.455068 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:16:53.472559 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:53.473907 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:16:53.475033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:16:53.475033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:53.475033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:53.475033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 426/845] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:16:53.480010 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:53.588958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555e3e-1225-448a-9f86-aa3a6980df97 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:53.624795 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:53.625433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:53.625793 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:53.626039 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:53.626749 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:53.627054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:53.628615 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:53.641899 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 420/846] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:53.649215 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:53.754049 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:53.764755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c6a8-08a1-4571-80c2-412ea87567c7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:53.801600 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:53.803523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:53.803523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:53.803523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] PATH_INFO: `/v3/users/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:53.811720 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:53.813175 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:16:53.826388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:53.827544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:53.828508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 427/847] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:53.834594 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:53.890749 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:53.951803 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cfc67-eb8f-42a2-b895-0e6c120cd296 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:53.990946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:53.991649 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:53.991999 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:53.992360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:53.993213 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:53.993545 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:53.995025 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:54.014561 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 421/848] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Sep 14 15:16:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:54.020704 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:54.125245 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fd502-8a7b-4d41-8574-349d23eebfcf None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:54.159706 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:54.160351 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:54.160628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:54.160881 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:54.172130 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:54.174374 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:16:54.189010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:54.190481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:16:54.191659 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:16:54.191659 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:54.191659 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:54.191659 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 428/849] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:16:54.195860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:54.307966 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff0145-88fe-4fd1-92e9-72965844698b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:54.310433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:54.344679 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:54.345983 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:54.346373 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:54.346722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:54.347518 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:54.347859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:54.349715 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:54.363101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 422/850] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:54.368798 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:54.371686 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:54.479918 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff29bd3-816a-4c35-9f1a-79e540341137 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:54.514696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:54.515398 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:54.515687 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:54.516055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:54.523546 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:54.525014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:16:54.537653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:54.538782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:54.539712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 429/851] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:16:54.545482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:54.652666 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72843c-1de7-457f-8e1c-23bf029b2234 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:54.687403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8eae06-314b-46a1-a21b-c25c283ee8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:54.688143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eae06-314b-46a1-a21b-c25c283ee8b3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:54.688438 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eae06-314b-46a1-a21b-c25c283ee8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:54.688710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eae06-314b-46a1-a21b-c25c283ee8b3 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:54.689441 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8eae06-314b-46a1-a21b-c25c283ee8b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:54.689756 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8eae06-314b-46a1-a21b-c25c283ee8b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:54.691269 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8eae06-314b-46a1-a21b-c25c283ee8b3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:54.704125 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 423/852] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:54.711923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:54.782451 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:54.826186 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f522d0a-326d-44bb-8b57-0fe2c0e0e7ba None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:54.860809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044ca22-9e22-4bd2-b632-17140f4bec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:54.861482 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ca22-9e22-4bd2-b632-17140f4bec9b None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:54.861755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ca22-9e22-4bd2-b632-17140f4bec9b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:54.862036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ca22-9e22-4bd2-b632-17140f4bec9b None admin] PATH_INFO: `/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/55d0e3301ff94f37a05bfd75397956d0/roles/ecd0cffe7b2b441a8a4669f7e49e97fd` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:54.879385 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044ca22-9e22-4bd2-b632-17140f4bec9b None admin] RBAC: Authorizing `identity:create_grant(project_id=0be6d4eeb19e4b57b595d5bcb139e9fb, user_id=55d0e3301ff94f37a05bfd75397956d0, role_id=ecd0cffe7b2b441a8a4669f7e49e97fd)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:54.880836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044ca22-9e22-4bd2-b632-17140f4bec9b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:54.894172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 430/853] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:16:54 2022] PUT /identity/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/55d0e3301ff94f37a05bfd75397956d0/roles/ecd0cffe7b2b441a8a4669f7e49e97fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:16:57.277750 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924139-3d54-447b-9de6-bfc761a7c913 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:57.278478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924139-3d54-447b-9de6-bfc761a7c913 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:57.278478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924139-3d54-447b-9de6-bfc761a7c913 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:57.279648 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 424/854] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:16:57.285415 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25efc-e5f7-4377-b214-c67242ec7cb3 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:57.285949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25efc-e5f7-4377-b214-c67242ec7cb3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:57.285949 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25efc-e5f7-4377-b214-c67242ec7cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:57.305092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7ba25efc-e5f7-4377-b214-c67242ec7cb3 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:16:57.306429 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7ba25efc-e5f7-4377-b214-c67242ec7cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:16:57.379446 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 431/855] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:16:57 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:16:57.729517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924139-3d54-447b-9de6-bfc761a7c913 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:57.760480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:57.847444 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924139-3d54-447b-9de6-bfc761a7c913 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:57.884332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fb60-0c18-41d2-8049-d84cff423f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:57.884997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fb60-0c18-41d2-8049-d84cff423f2c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:57.885277 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fb60-0c18-41d2-8049-d84cff423f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:57.885578 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fb60-0c18-41d2-8049-d84cff423f2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:57.896924 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68fb60-0c18-41d2-8049-d84cff423f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-dd68fb60-0c18-41d2-8049-d84cff423f2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:16:57.901900 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:57.903014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:16:57.903860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 425/856] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Sep 14 15:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:57.909206 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba25efc-e5f7-4377-b214-c67242ec7cb3 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:57.961036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:58.029909 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba25efc-e5f7-4377-b214-c67242ec7cb3 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:58.067580 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:58.068192 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:58.068472 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:58.068739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:58.069436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:58.069738 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:58.071102 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:58.079846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 432/857] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Sep 14 15:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:58.086159 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fb60-0c18-41d2-8049-d84cff423f2c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:58.184908 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:58.206064 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fb60-0c18-41d2-8049-d84cff423f2c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:58.243131 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:58.243782 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:58.244083 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:58.244368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:58.255989 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:58.257478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:16:58.272434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:58.273565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:16:58.274738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:16:58.274738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:58.274738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:16:58.274738 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 426/858] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:58.279359 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:58.404105 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20ee9-a3de-4672-b10b-9a2a2cf2bc0d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:58.407044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:58.444864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:58.445521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:58.445806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:58.446081 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:58.446722 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:58.447027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:58.448523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:58.462042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 433/859] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:58.468043 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:58.580408 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759aa80-1e22-4a0d-b9dd-1d81e302d51b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:58.617029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:58.617819 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:58.618127 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:58.618397 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:58.621304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:58.628086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:58.629956 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:16:58.644927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:58.646345 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:16:58.647768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:16:58.649870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 427/860] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:16:58.656961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:58.769205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c2174-d343-4d33-8a0c-48968919dc24 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:58.806263 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:58.806946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:58.807233 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:58.807507 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:58.808321 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:58.808640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:58.810107 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:58.829413 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 434/861] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Sep 14 15:16:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:58.836400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:58.950526 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6337e1-e8e8-41cb-845e-09695de48fdb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:58.990425 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ffb9b-408f-4e7a-be9b-4ced07eb9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:58.991122 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ffb9b-408f-4e7a-be9b-4ced07eb9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:58.991406 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ffb9b-408f-4e7a-be9b-4ced07eb9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:58.991770 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ffb9b-408f-4e7a-be9b-4ced07eb9ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:59.067464 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:59.075319 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ffb9b-408f-4e7a-be9b-4ced07eb9ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:59.076957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ffb9b-408f-4e7a-be9b-4ced07eb9ec6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:59.199958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 428/862] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:16:58 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:16:59.210239 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:59.240484 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:59.337007 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980be5ae-72f2-44ab-af2d-2683ebae66e2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:59.377245 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:59.377956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:59.378246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:59.378554 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:59.391573 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:59.393209 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:16:59.411169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:59.412697 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:16:59.413652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:16:59.413652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:16:59.413652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:59.413652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 435/863] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:59.418384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ffb9b-408f-4e7a-be9b-4ced07eb9ec6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:59.521938 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:59.528970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ffb9b-408f-4e7a-be9b-4ced07eb9ec6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:59.566198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:59.566821 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:59.567104 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:59.567386 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:59.568101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:59.568344 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:59.569755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:59.581813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 429/864] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:59.587434 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:59.675194 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:16:59.703152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedf2c3-91a9-4c94-b285-b3bdeb44dc84 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:59.744747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:59.745516 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:59.745876 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:59.746220 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:59.753614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:59.755295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:16:59.768200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:16:59.769463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:16:59.771302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 436/865] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:16:59.776370 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:16:59.895243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff871-11ec-4221-8714-4e0ce51b5836 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:16:59.935991 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369f853-e6c5-4273-bae6-25f6aefe2f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:16:59.936809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369f853-e6c5-4273-bae6-25f6aefe2f71 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:16:59.936943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369f853-e6c5-4273-bae6-25f6aefe2f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:16:59.937530 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369f853-e6c5-4273-bae6-25f6aefe2f71 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:16:59.938600 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369f853-e6c5-4273-bae6-25f6aefe2f71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:16:59.939146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369f853-e6c5-4273-bae6-25f6aefe2f71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:16:59.941374 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369f853-e6c5-4273-bae6-25f6aefe2f71 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:16:59.955596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 430/866] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:16:59.961842 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:00.089108 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c678c-7d62-4af8-a37c-762b18bd6e01 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:00.125749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffa0c2-dcbc-4e37-9d92-b6e5556d3d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:00.126359 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa0c2-dcbc-4e37-9d92-b6e5556d3d21 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:00.127310 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa0c2-dcbc-4e37-9d92-b6e5556d3d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:00.127812 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa0c2-dcbc-4e37-9d92-b6e5556d3d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:00.128683 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffa0c2-dcbc-4e37-9d92-b6e5556d3d21 None admin] RBAC: Adding query filter params (role.id=ecd0cffe7b2b441a8a4669f7e49e97fd, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=55d0e3301ff94f37a05bfd75397956d0) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:00.129197 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffa0c2-dcbc-4e37-9d92-b6e5556d3d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:00.130856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffa0c2-dcbc-4e37-9d92-b6e5556d3d21 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:00.132771 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:00.145763 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 437/867] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:16:59 2022] GET /identity/v3/role_assignments?user.id=55d0e3301ff94f37a05bfd75397956d0&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=ecd0cffe7b2b441a8a4669f7e49e97fd => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:17:02.748572 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d99a3-7711-4621-a91f-e79050cde330 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:02.749091 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d99a3-7711-4621-a91f-e79050cde330 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:02.749091 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d99a3-7711-4621-a91f-e79050cde330 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:02.750642 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 431/868] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:02.756152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e4ed6-8a8c-4da9-b78f-c88eb22b88a4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:02.756595 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e4ed6-8a8c-4da9-b78f-c88eb22b88a4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:02.756703 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e4ed6-8a8c-4da9-b78f-c88eb22b88a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:02.775546 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-304e4ed6-8a8c-4da9-b78f-c88eb22b88a4 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:02.776704 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-304e4ed6-8a8c-4da9-b78f-c88eb22b88a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:02.844539 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 438/869] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:02 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:17:03.168164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d99a3-7711-4621-a91f-e79050cde330 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:03.186002 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:03.269945 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d99a3-7711-4621-a91f-e79050cde330 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:03.302908 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52ff39-8a9b-4496-a296-e92c00dd56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:03.303529 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ff39-8a9b-4496-a296-e92c00dd56d1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:03.303807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ff39-8a9b-4496-a296-e92c00dd56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:03.304079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ff39-8a9b-4496-a296-e92c00dd56d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:03.314536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52ff39-8a9b-4496-a296-e92c00dd56d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8e52ff39-8a9b-4496-a296-e92c00dd56d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:17:03.319631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:03.320708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:03.322493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 432/870] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:03.326627 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e4ed6-8a8c-4da9-b78f-c88eb22b88a4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:03.421979 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e4ed6-8a8c-4da9-b78f-c88eb22b88a4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:03.447972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:03.455938 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:03.456540 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:03.456820 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:03.457089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:03.457770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:03.458070 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:03.459450 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:03.467200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 439/871] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:03.472990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52ff39-8a9b-4496-a296-e92c00dd56d1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:03.547745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:03.570934 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52ff39-8a9b-4496-a296-e92c00dd56d1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:03.603298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:03.603909 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:03.604184 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:03.604452 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:03.614617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:03.616039 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:17:03.630729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:03.631847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:17:03.632946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:17:03.632946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:03.632946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:03.632946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 433/872] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:03.638581 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:03.734954 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b17ed-d2ca-4313-ae42-72a2f008ac78 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:03.768021 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:03.768645 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:03.768876 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:03.769144 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:03.769798 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:03.770098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:03.771479 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:03.783421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 440/873] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:03.788970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:03.886601 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc273f-afa8-40cf-9a70-4d011c871cd5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:03.911801 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:03.919640 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:03.920260 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:03.920544 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:03.920820 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:03.929428 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:03.930865 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:17:03.941742 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:03.942802 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:03.944006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 434/874] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:03.948578 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:04.012212 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:04.064796 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebb58b-655b-431f-b061-0e10b98cebe9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:04.098347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:04.098941 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:04.099217 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:04.099484 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:04.100196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:04.100502 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:04.101951 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:04.119074 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 441/875] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Sep 14 15:17:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:04.124761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:04.221392 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df3a6d-b448-4d3f-b317-1a57a4c28450 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:04.252822 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197439-c170-4eaf-994c-843c9fc7d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:04.253433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197439-c170-4eaf-994c-843c9fc7d68d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:04.253710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197439-c170-4eaf-994c-843c9fc7d68d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:04.253979 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197439-c170-4eaf-994c-843c9fc7d68d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:04.307917 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:04.320164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b197439-c170-4eaf-994c-843c9fc7d68d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:04.321630 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b197439-c170-4eaf-994c-843c9fc7d68d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:04.417955 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 435/876] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:17:04 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:17:04.423678 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:04.520646 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a3a67-1496-4a0c-89c0-5a7e5af7e3a8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:04.529454 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:04.554493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:04.555134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:04.555394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:04.555665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:04.566053 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:04.567552 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:17:04.582959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:04.584118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:17:04.585016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:17:04.585016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:04.585016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:04.585016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 442/877] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:04.589786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197439-c170-4eaf-994c-843c9fc7d68d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:04.672956 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:04.684426 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197439-c170-4eaf-994c-843c9fc7d68d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:04.717168 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:04.717790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:04.718069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:04.718341 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:04.718967 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:04.719267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:04.720643 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:04.731241 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 436/878] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:04.736824 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:04.835340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1dd11-a1ee-485c-8ea2-e5de22233cb0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:04.868457 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:04.869070 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:04.869377 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:04.869657 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:04.876125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:04.878211 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:17:04.889591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:04.890598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:04.891520 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 443/879] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:04.896515 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:04.999143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1da39-6ca7-4962-864a-b8b5285c8816 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:05.035552 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d0dd7-1a9d-4452-8633-b0c0eea9b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:05.036154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d0dd7-1a9d-4452-8633-b0c0eea9b436 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:05.036435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d0dd7-1a9d-4452-8633-b0c0eea9b436 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:05.036708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d0dd7-1a9d-4452-8633-b0c0eea9b436 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:05.037415 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d0dd7-1a9d-4452-8633-b0c0eea9b436 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:05.037722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d0dd7-1a9d-4452-8633-b0c0eea9b436 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:05.039175 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d0dd7-1a9d-4452-8633-b0c0eea9b436 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:05.051444 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 437/880] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:05.057493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:05.079897 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:05.157021 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45043e-5c28-41bb-9bff-6ff52cf983ac None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:05.190355 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14c534-b0ea-4c49-8d0e-ae1b033ffb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:05.190945 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c534-b0ea-4c49-8d0e-ae1b033ffb64 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:05.191229 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c534-b0ea-4c49-8d0e-ae1b033ffb64 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:05.191506 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c534-b0ea-4c49-8d0e-ae1b033ffb64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:05.192223 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14c534-b0ea-4c49-8d0e-ae1b033ffb64 None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=55d0e3301ff94f37a05bfd75397956d0) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:05.192535 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14c534-b0ea-4c49-8d0e-ae1b033ffb64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:05.194000 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14c534-b0ea-4c49-8d0e-ae1b033ffb64 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:05.199232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 444/881] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:17:05 2022] GET /identity/v3/role_assignments?user.id=55d0e3301ff94f37a05bfd75397956d0&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=6211512533b744e8b1ee9031113654ac => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:07.577777 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125560c-1559-4362-968e-ad7599da0424 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:07.578300 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125560c-1559-4362-968e-ad7599da0424 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:07.578300 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125560c-1559-4362-968e-ad7599da0424 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:07.579658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 438/882] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:07.586848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb056-0b95-436e-900f-023043ac046c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:07.587298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb056-0b95-436e-900f-023043ac046c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:07.587414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb056-0b95-436e-900f-023043ac046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:07.604937 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7e5cb056-0b95-436e-900f-023043ac046c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:07.606168 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7e5cb056-0b95-436e-900f-023043ac046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:07.670395 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 445/883] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:07 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:17:07.989737 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125560c-1559-4362-968e-ad7599da0424 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:08.003419 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:08.091703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125560c-1559-4362-968e-ad7599da0424 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:08.125365 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae368c-68ea-4690-936f-9bd7fbfbfcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:08.125974 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae368c-68ea-4690-936f-9bd7fbfbfcf4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:08.126252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae368c-68ea-4690-936f-9bd7fbfbfcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:08.127109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae368c-68ea-4690-936f-9bd7fbfbfcf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:08.137063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae368c-68ea-4690-936f-9bd7fbfbfcf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-6bae368c-68ea-4690-936f-9bd7fbfbfcf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:17:08.141851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:08.142920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:08.143947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 439/884] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:17:08.148950 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cb056-0b95-436e-900f-023043ac046c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:08.163579 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:08.246586 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cb056-0b95-436e-900f-023043ac046c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:08.279885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:08.280500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:08.280781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:08.281057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:08.281760 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:08.282066 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:08.283953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:08.291791 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 446/885] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:08.297705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae368c-68ea-4690-936f-9bd7fbfbfcf4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:08.363069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:08.395412 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae368c-68ea-4690-936f-9bd7fbfbfcf4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:08.428098 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:08.428712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:08.428992 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:08.429263 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:08.439383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:08.440812 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:17:08.454388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:08.455505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:17:08.456551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:17:08.456551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:08.456551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:08.456551 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 440/886] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 15:17:08.461261 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:08.537765 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:08.560291 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af37c6-40af-48e2-ae03-27864e1a71f3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:08.592166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:08.592800 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:08.593037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:08.593308 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:08.593969 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:08.594268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:08.596463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:08.608054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 447/887] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:08.614325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:08.710948 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ec59-52d7-4e20-8acf-29fdb89ad2c8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:08.730099 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:08.744114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:08.744734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:08.745017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:08.745292 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:08.752594 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:08.754069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:17:08.765189 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:08.766298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:08.767851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 441/888] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:08.772889 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:08.868318 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090eb31-612a-46cd-9a1f-2767ae9a3f20 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:08.901556 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:08.902145 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:08.902422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:08.902688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:08.903394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:08.903693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:08.905107 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:08.907570 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:08.922628 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 448/889] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Sep 14 15:17:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:17:08.928266 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:09.034699 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24c91-2a96-452c-83d5-27437c777aa1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:09.067133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:09.067752 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.068039 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.068313 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.078418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:09.080484 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:17:09.094133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:09.095252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:17:09.096540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:17:09.096540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:09.096540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:09.096540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 442/890] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:09.100963 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:09.196692 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee97698-0962-455e-b7ef-2f44c58c657b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:09.229765 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:09.230363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.230644 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.230919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.231551 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:09.231853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:09.233208 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:09.244123 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 449/891] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:09.249839 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:09.281779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:09.349449 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89a38-1f3f-47c9-93dc-c1e036a39728 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:09.382882 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:09.383786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.384070 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.384347 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.390849 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:09.392288 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:17:09.403922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:09.404939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:09.406423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 443/892] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:09.410857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:09.465172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:09.510022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62015cef-e665-43e6-860b-4bc8d9a22951 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:09.542098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2dec7-14a1-41c7-87c2-3c6d219fc5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:09.542692 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2dec7-14a1-41c7-87c2-3c6d219fc5cf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.542971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2dec7-14a1-41c7-87c2-3c6d219fc5cf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.543241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2dec7-14a1-41c7-87c2-3c6d219fc5cf None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.543916 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2dec7-14a1-41c7-87c2-3c6d219fc5cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:09.544218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2dec7-14a1-41c7-87c2-3c6d219fc5cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:09.545665 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2dec7-14a1-41c7-87c2-3c6d219fc5cf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:09.558648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 450/893] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:09.564842 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:09.655279 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:09.664712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c4826-1f4e-4670-afac-1f0db24d4b88 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:09.696360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de597f-927c-46e4-a5e7-2d555ff5b0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:09.696999 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de597f-927c-46e4-a5e7-2d555ff5b0a6 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:09.697281 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de597f-927c-46e4-a5e7-2d555ff5b0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:09.697584 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de597f-927c-46e4-a5e7-2d555ff5b0a6 None admin] PATH_INFO: `/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/55d0e3301ff94f37a05bfd75397956d0/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:09.699450 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de597f-927c-46e4-a5e7-2d555ff5b0a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be6d4eeb19e4b57b595d5bcb139e9fb, user_id=55d0e3301ff94f37a05bfd75397956d0, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:09.700865 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de597f-927c-46e4-a5e7-2d555ff5b0a6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:09.714327 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 444/894] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Sep 14 15:17:09 2022] PUT /identity/v3/projects/0be6d4eeb19e4b57b595d5bcb139e9fb/users/55d0e3301ff94f37a05bfd75397956d0/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:17:12.102318 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7533df-669e-4a49-bf5d-06afec46874b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:12.102868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7533df-669e-4a49-bf5d-06afec46874b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:12.102868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7533df-669e-4a49-bf5d-06afec46874b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:12.104205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 451/895] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:12.109361 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7542-fc58-46b8-b81d-32baca56eb32 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:12.109755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7542-fc58-46b8-b81d-32baca56eb32 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:12.109950 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7542-fc58-46b8-b81d-32baca56eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:12.128305 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-69cb7542-fc58-46b8-b81d-32baca56eb32 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:12.129529 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-69cb7542-fc58-46b8-b81d-32baca56eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:12.198445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 445/896] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:12 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:17:12.526390 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7533df-669e-4a49-bf5d-06afec46874b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:12.623918 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7533df-669e-4a49-bf5d-06afec46874b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:12.638347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:12.659405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b9c2-4bff-43b2-a7e7-dca15d056c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:12.660030 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b9c2-4bff-43b2-a7e7-dca15d056c86 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:12.660307 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b9c2-4bff-43b2-a7e7-dca15d056c86 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:12.660577 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b9c2-4bff-43b2-a7e7-dca15d056c86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:12.670353 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91b9c2-4bff-43b2-a7e7-dca15d056c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1d91b9c2-4bff-43b2-a7e7-dca15d056c86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 15:17:12.675258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:12.676358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:12.677557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 452/897] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Sep 14 15:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:12.682374 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb7542-fc58-46b8-b81d-32baca56eb32 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:12.761590 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:12.780496 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb7542-fc58-46b8-b81d-32baca56eb32 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:12.812689 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:12.813289 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:12.813596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:12.813870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:12.815011 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:12.815313 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:12.816660 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:12.824370 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 446/898] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Sep 14 15:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:17:12.830841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b9c2-4bff-43b2-a7e7-dca15d056c86 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:12.926333 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b9c2-4bff-43b2-a7e7-dca15d056c86 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:12.963449 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:12.964066 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:12.964342 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:12.964612 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:12.975538 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:12.977404 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:17:12.995258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:12.996499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:17:12.997460 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:17:12.997460 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:12.997460 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:12.997460 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 453/899] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:13.002961 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:13.110008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee7966-0eee-4a9e-827c-8c744d3ccb7e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:13.142761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:13.143354 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:13.143631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:13.143903 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:13.144534 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:13.144838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:13.146219 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:13.157323 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 447/900] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:13.163048 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:13.192484 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:13.263788 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebafcbc-7938-496e-9bb7-b26cde007a8f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:13.296137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:13.296762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:13.297042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:13.297344 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:13.305168 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:13.306653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 15:17:13.318306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:13.319372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:13.320366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 454/901] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:13.325143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:13.328921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:13.421102 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76cd9-6625-4fef-9bf4-4be787ed18a6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:13.454601 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:13.455192 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:13.455471 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:13.455741 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:13.456453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:13.456755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:13.458194 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:13.475198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 448/902] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Sep 14 15:17:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:13.480904 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:13.565546 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:13.580259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da4086-6976-43fd-b032-fab994a18099 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:13.613603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d996b4-2305-4dc1-a88c-40a4bde55aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:13.614201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d996b4-2305-4dc1-a88c-40a4bde55aa0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:13.614478 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d996b4-2305-4dc1-a88c-40a4bde55aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:13.614746 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d996b4-2305-4dc1-a88c-40a4bde55aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:13.680494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d996b4-2305-4dc1-a88c-40a4bde55aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:13.681883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d996b4-2305-4dc1-a88c-40a4bde55aa0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:13.761941 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:13.777051 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 455/903] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Sep 14 15:17:13 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 15:17:13.783335 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:13.841121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:13.879833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b13f-f6fc-4b44-8f79-b0916c18e665 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:13.914495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:13.915119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:13.915402 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:13.915674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:13.925819 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:13.927375 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 15:17:13.941753 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:13.942916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 15:17:13.943829 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 15:17:13.943829 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 15:17:13.943829 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:13.943829 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 449/904] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:13.948461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d996b4-2305-4dc1-a88c-40a4bde55aa0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:14.047134 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d996b4-2305-4dc1-a88c-40a4bde55aa0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:14.080528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:14.081123 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:14.081422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:14.081693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:14.082311 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:14.082606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:14.083964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:14.094673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 456/905] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Sep 14 15:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:14.100993 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:14.196950 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157a58b-d28c-473d-81ea-84bd3202ebf6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:14.210383 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:14.230413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:14.231031 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:14.231310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:14.231581 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:14.237963 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:14.239374 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 15:17:14.250199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:14.251251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: ERROR keystone.server.flask.application Sep 14 15:17:14.253008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 450/906] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Sep 14 15:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:14.257637 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:14.304852 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:14.358315 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b7db2-3e86-4676-8637-1210631af70b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:14.391544 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c08b73-6e60-4f45-a302-e010a7facd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:14.392749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c08b73-6e60-4f45-a302-e010a7facd2b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:14.393027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c08b73-6e60-4f45-a302-e010a7facd2b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:14.393302 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c08b73-6e60-4f45-a302-e010a7facd2b None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:14.394012 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c08b73-6e60-4f45-a302-e010a7facd2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:14.394317 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c08b73-6e60-4f45-a302-e010a7facd2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:14.395730 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c08b73-6e60-4f45-a302-e010a7facd2b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:14.407207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 457/907] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Sep 14 15:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:14.413353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:14.510201 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e488e-5101-40d7-857a-13fedb13f039 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:14.543306 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd7c42-0501-4894-9e37-e2cf7f0833c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:14.543896 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7c42-0501-4894-9e37-e2cf7f0833c3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:14.544179 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7c42-0501-4894-9e37-e2cf7f0833c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:14.544454 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7c42-0501-4894-9e37-e2cf7f0833c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:14.545170 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd7c42-0501-4894-9e37-e2cf7f0833c3 None admin] RBAC: Adding query filter params (role.id=6211512533b744e8b1ee9031113654ac, scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb, user.id=55d0e3301ff94f37a05bfd75397956d0) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:14.545518 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd7c42-0501-4894-9e37-e2cf7f0833c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:14.546972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd7c42-0501-4894-9e37-e2cf7f0833c3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:14.552540 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 451/908] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Sep 14 15:17:14 2022] GET /identity/v3/role_assignments?user.id=55d0e3301ff94f37a05bfd75397956d0&scope.project.id=0be6d4eeb19e4b57b595d5bcb139e9fb&role.id=6211512533b744e8b1ee9031113654ac => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:16.954941 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3e10-3de8-4e4f-b170-a4b68ebf7376 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:16.955476 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3e10-3de8-4e4f-b170-a4b68ebf7376 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:16.955476 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3e10-3de8-4e4f-b170-a4b68ebf7376 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:16.956830 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 458/909] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:16.962014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adcad-de05-4e86-a0e6-1dd71540c163 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:16.962434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adcad-de05-4e86-a0e6-1dd71540c163 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:16.962567 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998adcad-de05-4e86-a0e6-1dd71540c163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:16.982033 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-998adcad-de05-4e86-a0e6-1dd71540c163 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:16.983258 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-998adcad-de05-4e86-a0e6-1dd71540c163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:17.019586 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:17.060418 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 452/910] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:17:17.390816 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a3e10-3de8-4e4f-b170-a4b68ebf7376 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:17.501201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a3e10-3de8-4e4f-b170-a4b68ebf7376 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:17.508305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:17.536326 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:17.536947 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:17.537224 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:17.537531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:17.538102 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:17.539467 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:17.548378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:17.550167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:17.551281 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 459/911] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Sep 14 15:17:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:17.556085 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998adcad-de05-4e86-a0e6-1dd71540c163 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:17.653992 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998adcad-de05-4e86-a0e6-1dd71540c163 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:17.688219 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e14c0-9b36-417e-af8c-b3378fdb38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:17.688816 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e14c0-9b36-417e-af8c-b3378fdb38c3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:17.689121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e14c0-9b36-417e-af8c-b3378fdb38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:17.689426 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e14c0-9b36-417e-af8c-b3378fdb38c3 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:17.690047 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e14c0-9b36-417e-af8c-b3378fdb38c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:17.690347 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e14c0-9b36-417e-af8c-b3378fdb38c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:17.691708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e14c0-9b36-417e-af8c-b3378fdb38c3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:17.696268 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 453/912] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Sep 14 15:17:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:17.702054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:17.801873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706bd18-e891-4c54-a2ba-6f1dd411897a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:17.834578 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec92fe-d6cc-4cd2-b371-faab915e523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:17.835180 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec92fe-d6cc-4cd2-b371-faab915e523b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:17.835463 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec92fe-d6cc-4cd2-b371-faab915e523b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:17.835740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec92fe-d6cc-4cd2-b371-faab915e523b None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:17.836359 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec92fe-d6cc-4cd2-b371-faab915e523b None admin] RBAC: Adding query filter params (type=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:17.836663 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec92fe-d6cc-4cd2-b371-faab915e523b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:17.838063 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec92fe-d6cc-4cd2-b371-faab915e523b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:17.842324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 460/913] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Sep 14 15:17:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:20.232736 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b04875-86e6-47e8-93e7-b0168d5159a7 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:20.233378 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b04875-86e6-47e8-93e7-b0168d5159a7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:20.233378 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b04875-86e6-47e8-93e7-b0168d5159a7 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:20.234806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 454/914] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:20.240788 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2b34-2c75-49b2-851c-10e00f588ab1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:20.241249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2b34-2c75-49b2-851c-10e00f588ab1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:20.241380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2b34-2c75-49b2-851c-10e00f588ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:20.260730 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-74dc2b34-2c75-49b2-851c-10e00f588ab1 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:20.261952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-74dc2b34-2c75-49b2-851c-10e00f588ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:20.287967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:20.328146 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 461/915] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:17:20.647554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b04875-86e6-47e8-93e7-b0168d5159a7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:20.678086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:20.746700 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b04875-86e6-47e8-93e7-b0168d5159a7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:20.780140 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e92045-9fae-4915-81f1-e032464254f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:20.780745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e92045-9fae-4915-81f1-e032464254f9 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:20.781021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e92045-9fae-4915-81f1-e032464254f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:20.781292 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e92045-9fae-4915-81f1-e032464254f9 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:20.781969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e92045-9fae-4915-81f1-e032464254f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:20.784005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e92045-9fae-4915-81f1-e032464254f9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:20.799492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 455/916] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Sep 14 15:17:20 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:17:23.157705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa9e0b-82d7-4362-8068-7c6b74f07789 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:23.158266 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa9e0b-82d7-4362-8068-7c6b74f07789 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:23.158266 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa9e0b-82d7-4362-8068-7c6b74f07789 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:23.159598 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 462/917] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:23.164713 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b32cf-b976-4cfc-97e0-d18cff944bec None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:23.165148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b32cf-b976-4cfc-97e0-d18cff944bec None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:23.165272 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b32cf-b976-4cfc-97e0-d18cff944bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:23.183592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-051b32cf-b976-4cfc-97e0-d18cff944bec None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:23.184777 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-051b32cf-b976-4cfc-97e0-d18cff944bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:23.255598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 456/918] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:23 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 15:17:23.575599 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa9e0b-82d7-4362-8068-7c6b74f07789 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:23.675631 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa9e0b-82d7-4362-8068-7c6b74f07789 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:23.709648 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:23.710274 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:23.710555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:23.710830 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:23.711406 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:23.712772 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:23.721392 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:23.722461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:23.723375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 463/919] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Sep 14 15:17:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:23.728444 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b32cf-b976-4cfc-97e0-d18cff944bec None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:23.746625 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:23.827032 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b32cf-b976-4cfc-97e0-d18cff944bec None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:23.859200 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:23.859790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:23.860071 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:23.860344 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:23.861531 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:23.861836 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:23.863199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:23.868105 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 457/920] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Sep 14 15:17:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:23.874022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:23.902640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:23.973923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad168ca1-d7d8-4f29-a177-194ad56d38e3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:24.007948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa1ff7-d427-47e7-8b76-8b3f97f4c479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:24.008550 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1ff7-d427-47e7-8b76-8b3f97f4c479 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:24.009099 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1ff7-d427-47e7-8b76-8b3f97f4c479 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:24.009401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa1ff7-d427-47e7-8b76-8b3f97f4c479 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:24.010096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa1ff7-d427-47e7-8b76-8b3f97f4c479 None admin] RBAC: Adding query filter params (interface=public, service_id=791dde3f080b4b569531543d089bd4ee, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:24.010408 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa1ff7-d427-47e7-8b76-8b3f97f4c479 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:24.011805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa1ff7-d427-47e7-8b76-8b3f97f4c479 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:24.016646 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 464/921] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Sep 14 15:17:23 2022] GET /identity/v3/endpoints?service_id=791dde3f080b4b569531543d089bd4ee&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:24.022246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:24.101273 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:24.119764 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8c15d-9b98-406c-a23e-afac4c122d4b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:24.152644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e77e-c491-4a3a-a0c9-cb2aa2f08e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:24.153241 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e77e-c491-4a3a-a0c9-cb2aa2f08e2a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:24.153553 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e77e-c491-4a3a-a0c9-cb2aa2f08e2a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:24.153830 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e77e-c491-4a3a-a0c9-cb2aa2f08e2a None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:24.154423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4e77e-c491-4a3a-a0c9-cb2aa2f08e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:24.155786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4e77e-c491-4a3a-a0c9-cb2aa2f08e2a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:24.162541 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 458/922] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Sep 14 15:17:24 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:17:26.527421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d0a46-0a79-4ae0-823a-791f09b6ff3c None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:26.527967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d0a46-0a79-4ae0-823a-791f09b6ff3c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:26.527967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d0a46-0a79-4ae0-823a-791f09b6ff3c None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:26.529334 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 465/923] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:17:26.534443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4738755-8fa8-4e4d-a90f-e4741722e5ab None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:26.534827 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4738755-8fa8-4e4d-a90f-e4741722e5ab None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:26.535005 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4738755-8fa8-4e4d-a90f-e4741722e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:26.552751 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e4738755-8fa8-4e4d-a90f-e4741722e5ab None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:17:26.553975 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e4738755-8fa8-4e4d-a90f-e4741722e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:17:26.620885 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 459/924] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:17:26 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 15:17:26.940334 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d0a46-0a79-4ae0-823a-791f09b6ff3c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:27.031521 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:27.042077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d0a46-0a79-4ae0-823a-791f09b6ff3c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:27.075010 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:27.075629 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:27.075905 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:27.076175 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:27.076741 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:27.078140 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 15:17:27.086630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 15:17:27.087773 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: ERROR keystone.server.flask.application Sep 14 15:17:27.088623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 466/925] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Sep 14 15:17:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 15:17:27.093790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4738755-8fa8-4e4d-a90f-e4741722e5ab None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:27.169266 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:27.192411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4738755-8fa8-4e4d-a90f-e4741722e5ab None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:27.225720 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555a5d5-77da-4fec-bbce-2883ae1f0bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:27.226317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555a5d5-77da-4fec-bbce-2883ae1f0bb3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:27.226599 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555a5d5-77da-4fec-bbce-2883ae1f0bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:27.226872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555a5d5-77da-4fec-bbce-2883ae1f0bb3 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:27.227495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555a5d5-77da-4fec-bbce-2883ae1f0bb3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:17:27.227798 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555a5d5-77da-4fec-bbce-2883ae1f0bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:27.229157 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555a5d5-77da-4fec-bbce-2883ae1f0bb3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:27.234021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 460/926] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Sep 14 15:17:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:17:27.240409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:17:27.339136 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088458e-b562-49fe-ba22-80afaed83d16 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:17:27.372762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7919f0b-b00e-4afb-8e81-5642b6be8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:17:27.373401 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919f0b-b00e-4afb-8e81-5642b6be8551 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:17:27.373685 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919f0b-b00e-4afb-8e81-5642b6be8551 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:17:27.373962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919f0b-b00e-4afb-8e81-5642b6be8551 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:17:27.374627 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7919f0b-b00e-4afb-8e81-5642b6be8551 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:17:27.375983 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7919f0b-b00e-4afb-8e81-5642b6be8551 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:17:27.395734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 467/927] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:17:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:17:37.232023 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=30 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:17:37.391004 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:27.846618 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c12390-70d1-44a8-b15e-70eb4ad6fac0 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:27.847188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c12390-70d1-44a8-b15e-70eb4ad6fac0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:27.847188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c12390-70d1-44a8-b15e-70eb4ad6fac0 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:27.849722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 461/928] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:27.854031 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fca1c-1940-4c54-8b43-960072a0b98f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:27.854914 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fca1c-1940-4c54-8b43-960072a0b98f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:27.855164 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fca1c-1940-4c54-8b43-960072a0b98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:27.879876 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e81fca1c-1940-4c54-8b43-960072a0b98f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:27.882042 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e81fca1c-1940-4c54-8b43-960072a0b98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:27.964624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 468/929] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:28.323192 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5a6f-9ced-4588-838c-c094ea5cb0a0 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:28.323484 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5a6f-9ced-4588-838c-c094ea5cb0a0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:28.323757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd5a6f-9ced-4588-838c-c094ea5cb0a0 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:28.325090 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 462/930] 10.222.0.66 () {54 vars in 965 bytes} [Wed Sep 14 15:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:28.331469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb6719-b3ff-4851-83c9-2c7bd09fcec8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:28.331757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb6719-b3ff-4851-83c9-2c7bd09fcec8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:28.332033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb6719-b3ff-4851-83c9-2c7bd09fcec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:28.392673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-60cb6719-b3ff-4851-83c9-2c7bd09fcec8 None None] MFA Rules not processed for user `61155f66cf144f068dabc2000afcccf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:28.393857 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-60cb6719-b3ff-4851-83c9-2c7bd09fcec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:28.455865 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 469/931] 10.222.0.66 () {58 vars in 1062 bytes} [Wed Sep 14 15:18:28 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:28.465049 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd5a6f-9ced-4588-838c-c094ea5cb0a0 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:28.476297 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd5a6f-9ced-4588-838c-c094ea5cb0a0 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:28.479743 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f9481-1ddc-4ed4-a8f1-16d6b5083630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:28.480363 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f9481-1ddc-4ed4-a8f1-16d6b5083630 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:28.480642 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f9481-1ddc-4ed4-a8f1-16d6b5083630 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:28.480915 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f9481-1ddc-4ed4-a8f1-16d6b5083630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:28.492105 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f9481-1ddc-4ed4-a8f1-16d6b5083630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:28.493932 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f9481-1ddc-4ed4-a8f1-16d6b5083630 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:28.503893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 463/932] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:31.174765 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c04776-f78f-4c23-b87e-b15263f5c109 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:31.175266 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c04776-f78f-4c23-b87e-b15263f5c109 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:31.175358 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c04776-f78f-4c23-b87e-b15263f5c109 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:31.176712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 470/933] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:31.181859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bfd4c-2b9b-40c2-9e01-554f508f6caf None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:31.182275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bfd4c-2b9b-40c2-9e01-554f508f6caf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:31.182955 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bfd4c-2b9b-40c2-9e01-554f508f6caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:31.202606 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f62bfd4c-2b9b-40c2-9e01-554f508f6caf None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:31.203839 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f62bfd4c-2b9b-40c2-9e01-554f508f6caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:31.211511 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 464/934] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:31.545200 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c04776-f78f-4c23-b87e-b15263f5c109 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:31.556349 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c04776-f78f-4c23-b87e-b15263f5c109 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:31.559881 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b614d-575f-4443-bfd1-0b86d7aa93b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:31.560534 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b614d-575f-4443-bfd1-0b86d7aa93b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:31.560814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b614d-575f-4443-bfd1-0b86d7aa93b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:31.561088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b614d-575f-4443-bfd1-0b86d7aa93b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:31.570225 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b614d-575f-4443-bfd1-0b86d7aa93b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:31.571662 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b614d-575f-4443-bfd1-0b86d7aa93b7 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:31.581398 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 471/935] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:34.325116 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff132f-4691-4ed1-aa18-06efc8d1d6c7 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:34.325632 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff132f-4691-4ed1-aa18-06efc8d1d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:34.325713 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff132f-4691-4ed1-aa18-06efc8d1d6c7 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:34.327176 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 465/936] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:34.332670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50f23-a42f-40b6-8db1-bb5993c5cad7 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:34.333077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50f23-a42f-40b6-8db1-bb5993c5cad7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:34.333257 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50f23-a42f-40b6-8db1-bb5993c5cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:34.373584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-10e50f23-a42f-40b6-8db1-bb5993c5cad7 None None] MFA Rules not processed for user `75bdb90f8d494c9ca53db67b74924493`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:34.375132 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-10e50f23-a42f-40b6-8db1-bb5993c5cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:34.420652 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:18:34.453422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 472/937] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:34 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:34.790682 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff132f-4691-4ed1-aa18-06efc8d1d6c7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:34.801768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff132f-4691-4ed1-aa18-06efc8d1d6c7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:34.805137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fb3ba-97e4-43fe-9b5c-a0011cff390a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:34.805761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fb3ba-97e4-43fe-9b5c-a0011cff390a service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:34.806037 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fb3ba-97e4-43fe-9b5c-a0011cff390a service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:34.806305 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fb3ba-97e4-43fe-9b5c-a0011cff390a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:34.815987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fb3ba-97e4-43fe-9b5c-a0011cff390a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:34.817416 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fb3ba-97e4-43fe-9b5c-a0011cff390a service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:34.827053 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 466/938] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:34 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:37.880891 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68eaa6-f954-45a9-9ff2-d7b07343c051 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:37.881456 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68eaa6-f954-45a9-9ff2-d7b07343c051 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:37.881621 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68eaa6-f954-45a9-9ff2-d7b07343c051 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:37.883055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 473/939] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:37.888734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df3c47-b84c-4d01-9d57-d198ebcb0cf9 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:37.889155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df3c47-b84c-4d01-9d57-d198ebcb0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:37.889333 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df3c47-b84c-4d01-9d57-d198ebcb0cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:37.908207 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-34df3c47-b84c-4d01-9d57-d198ebcb0cf9 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:37.909455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-34df3c47-b84c-4d01-9d57-d198ebcb0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:37.979894 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 467/940] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:37 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:38.320853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68eaa6-f954-45a9-9ff2-d7b07343c051 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:38.331380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68eaa6-f954-45a9-9ff2-d7b07343c051 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:38.334877 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebef3d9-21f3-4a8f-9c42-03080f961e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:38.335474 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef3d9-21f3-4a8f-9c42-03080f961e30 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:38.335755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef3d9-21f3-4a8f-9c42-03080f961e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:38.336029 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef3d9-21f3-4a8f-9c42-03080f961e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:38.345143 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebef3d9-21f3-4a8f-9c42-03080f961e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:38.346611 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebef3d9-21f3-4a8f-9c42-03080f961e30 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:38.355760 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 474/941] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:38 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:41.412988 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52250d-2d8f-4184-9460-f2a3519ff2ea None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:41.413565 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52250d-2d8f-4184-9460-f2a3519ff2ea None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:41.413746 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52250d-2d8f-4184-9460-f2a3519ff2ea None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:41.414936 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 468/942] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:41.420294 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fc01-78e9-4b66-a94d-992d300b7b05 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:41.420701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fc01-78e9-4b66-a94d-992d300b7b05 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:41.420841 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fc01-78e9-4b66-a94d-992d300b7b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:41.440223 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2d99fc01-78e9-4b66-a94d-992d300b7b05 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:41.441421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2d99fc01-78e9-4b66-a94d-992d300b7b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:41.449159 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 475/943] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:41.782281 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52250d-2d8f-4184-9460-f2a3519ff2ea None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:41.793250 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52250d-2d8f-4184-9460-f2a3519ff2ea None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:41.797373 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e8922-8c76-461a-83a1-86c06f238d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:41.797982 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e8922-8c76-461a-83a1-86c06f238d1c service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:41.798285 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e8922-8c76-461a-83a1-86c06f238d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:41.798560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e8922-8c76-461a-83a1-86c06f238d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:41.808568 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e8922-8c76-461a-83a1-86c06f238d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:41.810054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e8922-8c76-461a-83a1-86c06f238d1c service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:41.820750 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 469/944] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:44.308995 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ea88-62fc-4ee8-8d44-b2a03ea36832 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:44.309542 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ea88-62fc-4ee8-8d44-b2a03ea36832 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:44.309653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ea88-62fc-4ee8-8d44-b2a03ea36832 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:44.311066 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 476/945] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:44.316562 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5145-22f3-46ea-97f7-248e56854e9e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:44.317006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5145-22f3-46ea-97f7-248e56854e9e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:44.317099 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5145-22f3-46ea-97f7-248e56854e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:44.336053 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-188e5145-22f3-46ea-97f7-248e56854e9e None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:44.337237 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-188e5145-22f3-46ea-97f7-248e56854e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:44.345373 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 470/946] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:44.674593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99ea88-62fc-4ee8-8d44-b2a03ea36832 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:44.685355 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99ea88-62fc-4ee8-8d44-b2a03ea36832 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:44.688797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ee4fa-274d-4177-b380-3aebf01e6eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:44.689419 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ee4fa-274d-4177-b380-3aebf01e6eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:44.689702 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ee4fa-274d-4177-b380-3aebf01e6eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:44.689975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ee4fa-274d-4177-b380-3aebf01e6eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:44.698660 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ee4fa-274d-4177-b380-3aebf01e6eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:44.700086 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ee4fa-274d-4177-b380-3aebf01e6eb9 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:44.710550 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 477/947] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:47.191880 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527af37-12d9-4fec-919a-a2992a64aa17 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:47.192403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527af37-12d9-4fec-919a-a2992a64aa17 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:47.192493 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527af37-12d9-4fec-919a-a2992a64aa17 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:47.193890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 471/948] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:47.199232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7838a-2636-4df6-9b97-86a70681f6e4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:47.199618 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7838a-2636-4df6-9b97-86a70681f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:47.199859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7838a-2636-4df6-9b97-86a70681f6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:47.219749 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-cda7838a-2636-4df6-9b97-86a70681f6e4 None None] MFA Rules not processed for user `75bdb90f8d494c9ca53db67b74924493`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:47.220870 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cda7838a-2636-4df6-9b97-86a70681f6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:47.228619 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 478/949] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:47 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:47.583307 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527af37-12d9-4fec-919a-a2992a64aa17 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:47.595613 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527af37-12d9-4fec-919a-a2992a64aa17 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:47.599153 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45468364-e18e-49d7-af73-6443a83054f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:47.599752 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45468364-e18e-49d7-af73-6443a83054f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:47.600024 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45468364-e18e-49d7-af73-6443a83054f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:47.600291 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45468364-e18e-49d7-af73-6443a83054f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:47.610441 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45468364-e18e-49d7-af73-6443a83054f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:47.611853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45468364-e18e-49d7-af73-6443a83054f2 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:47.621065 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 472/950] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:47 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:50.231976 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdd937-e0dd-404b-b4c2-010305780102 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:50.232499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdd937-e0dd-404b-b4c2-010305780102 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:50.232620 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdd937-e0dd-404b-b4c2-010305780102 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:50.234447 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 479/951] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:50.240014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a806-d86c-4736-8b27-cb1d62241035 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:50.240485 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a806-d86c-4736-8b27-cb1d62241035 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:50.240576 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a806-d86c-4736-8b27-cb1d62241035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:50.260711 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9c15a806-d86c-4736-8b27-cb1d62241035 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:50.261865 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9c15a806-d86c-4736-8b27-cb1d62241035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:50.269744 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 473/952] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:50.605606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdd937-e0dd-404b-b4c2-010305780102 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:50.618341 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdd937-e0dd-404b-b4c2-010305780102 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:50.621819 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f110cd-1853-4730-84a3-d128e80f48dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:50.622415 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f110cd-1853-4730-84a3-d128e80f48dc service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:50.622693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f110cd-1853-4730-84a3-d128e80f48dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:50.622970 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f110cd-1853-4730-84a3-d128e80f48dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:50.632227 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f110cd-1853-4730-84a3-d128e80f48dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:50.633690 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f110cd-1853-4730-84a3-d128e80f48dc service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:50.644961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 480/953] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:53.122715 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1fe7-97ab-4a9f-a88c-af3b6d1b1083 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:53.123299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1fe7-97ab-4a9f-a88c-af3b6d1b1083 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:53.123299 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1fe7-97ab-4a9f-a88c-af3b6d1b1083 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:53.125156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 474/954] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:53.130438 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55c94-eda0-42df-be28-a32426bcf19c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:53.130908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55c94-eda0-42df-be28-a32426bcf19c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:53.131006 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55c94-eda0-42df-be28-a32426bcf19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:53.150883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-cdf55c94-eda0-42df-be28-a32426bcf19c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:53.152034 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cdf55c94-eda0-42df-be28-a32426bcf19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:53.160897 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 481/955] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:53.497278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1fe7-97ab-4a9f-a88c-af3b6d1b1083 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:53.508156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1fe7-97ab-4a9f-a88c-af3b6d1b1083 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:53.511944 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df530e4-b39d-40aa-9412-ce08c257224b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:53.512539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df530e4-b39d-40aa-9412-ce08c257224b service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:53.512820 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df530e4-b39d-40aa-9412-ce08c257224b service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:53.513093 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df530e4-b39d-40aa-9412-ce08c257224b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:53.522105 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df530e4-b39d-40aa-9412-ce08c257224b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:53.523522 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df530e4-b39d-40aa-9412-ce08c257224b service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:53.533379 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 475/956] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:18:56.399234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fd50-c7bc-4a3d-9f8b-5a5adbc34d88 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:56.399762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fd50-c7bc-4a3d-9f8b-5a5adbc34d88 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:56.399762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fd50-c7bc-4a3d-9f8b-5a5adbc34d88 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:56.401027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 482/957] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:18:56.406725 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5348bb-de42-4207-948f-5c049a2dcbbf None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:56.407105 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5348bb-de42-4207-948f-5c049a2dcbbf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:56.407275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5348bb-de42-4207-948f-5c049a2dcbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:56.427046 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7c5348bb-de42-4207-948f-5c049a2dcbbf None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:18:56.428252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7c5348bb-de42-4207-948f-5c049a2dcbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:18:56.436034 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 476/958] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:18:56 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:18:56.769624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2fd50-c7bc-4a3d-9f8b-5a5adbc34d88 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:18:56.780928 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2fd50-c7bc-4a3d-9f8b-5a5adbc34d88 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:18:56.784574 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c30d-a37c-430f-9d05-ba4b9462bff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:18:56.785165 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c30d-a37c-430f-9d05-ba4b9462bff4 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:18:56.785490 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c30d-a37c-430f-9d05-ba4b9462bff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:18:56.785767 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c30d-a37c-430f-9d05-ba4b9462bff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:18:56.794781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c30d-a37c-430f-9d05-ba4b9462bff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:18:56.796201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c30d-a37c-430f-9d05-ba4b9462bff4 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:18:56.805380 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 483/959] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:18:56 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:01.114595 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2965-ce10-4911-a352-bcf4d1a17f85 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:01.115148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2965-ce10-4911-a352-bcf4d1a17f85 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:01.115148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a2965-ce10-4911-a352-bcf4d1a17f85 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:01.116486 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 477/960] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:01.121983 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162e22-c325-4f93-9f85-b9bc9d0bd596 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:01.122409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162e22-c325-4f93-9f85-b9bc9d0bd596 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:01.122642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162e22-c325-4f93-9f85-b9bc9d0bd596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:01.143241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-94162e22-c325-4f93-9f85-b9bc9d0bd596 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:01.144426 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-94162e22-c325-4f93-9f85-b9bc9d0bd596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:01.152117 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 484/961] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:01.496080 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453bc4-acc2-49a7-9d7e-295f1eec9192 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:01.496437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453bc4-acc2-49a7-9d7e-295f1eec9192 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:01.496638 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453bc4-acc2-49a7-9d7e-295f1eec9192 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:01.497997 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 478/962] 10.222.0.66 () {54 vars in 965 bytes} [Wed Sep 14 15:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:01.504556 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665c3ce-147d-45ea-ab40-430116be7c11 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:01.504838 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665c3ce-147d-45ea-ab40-430116be7c11 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:01.505111 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665c3ce-147d-45ea-ab40-430116be7c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:01.524681 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c665c3ce-147d-45ea-ab40-430116be7c11 None None] MFA Rules not processed for user `61155f66cf144f068dabc2000afcccf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:01.525892 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c665c3ce-147d-45ea-ab40-430116be7c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:01.533945 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 485/963] 10.222.0.66 () {58 vars in 1062 bytes} [Wed Sep 14 15:19:01 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:19:01.543759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453bc4-acc2-49a7-9d7e-295f1eec9192 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:01.551232 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=74 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:01.557829 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453bc4-acc2-49a7-9d7e-295f1eec9192 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:01.561386 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26d5e-fa50-40d8-acc2-e41a61ac1ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:01.561986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26d5e-fa50-40d8-acc2-e41a61ac1ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:01.562265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26d5e-fa50-40d8-acc2-e41a61ac1ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:01.562541 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26d5e-fa50-40d8-acc2-e41a61ac1ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:01.571558 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26d5e-fa50-40d8-acc2-e41a61ac1ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:01.572923 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26d5e-fa50-40d8-acc2-e41a61ac1ff8 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:01.582464 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 479/964] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:05.195889 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbbb61-886f-45a9-961e-7f7d696d107b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:05.196455 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbbb61-886f-45a9-961e-7f7d696d107b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:05.196455 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbbb61-886f-45a9-961e-7f7d696d107b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:05.197844 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 486/965] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:05.203700 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629384-f842-4dcb-b80f-b2260b2e1277 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:05.204121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629384-f842-4dcb-b80f-b2260b2e1277 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:05.204433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629384-f842-4dcb-b80f-b2260b2e1277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:05.224170 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-95629384-f842-4dcb-b80f-b2260b2e1277 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:05.225303 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-95629384-f842-4dcb-b80f-b2260b2e1277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:05.233161 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 480/966] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:05 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:05.593806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbbb61-886f-45a9-961e-7f7d696d107b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:05.599142 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=51 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:05.606163 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbbb61-886f-45a9-961e-7f7d696d107b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:05.610442 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb28926-4845-4467-9128-d549b812d1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:05.611034 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28926-4845-4467-9128-d549b812d1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:05.611313 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28926-4845-4467-9128-d549b812d1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:05.611583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28926-4845-4467-9128-d549b812d1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:05.621216 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb28926-4845-4467-9128-d549b812d1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:05.622686 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb28926-4845-4467-9128-d549b812d1f5 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:05.632398 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 487/967] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:05 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:10.271952 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023323-e26d-475e-8d0a-99d08fbe9b0b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:10.272501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023323-e26d-475e-8d0a-99d08fbe9b0b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:10.272501 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023323-e26d-475e-8d0a-99d08fbe9b0b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:10.273880 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 481/968] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:10.279864 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efc44-e344-4d7f-8f3e-c249b42c461c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:10.280352 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efc44-e344-4d7f-8f3e-c249b42c461c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:10.280449 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efc44-e344-4d7f-8f3e-c249b42c461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:10.299405 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ea7efc44-e344-4d7f-8f3e-c249b42c461c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:10.301036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ea7efc44-e344-4d7f-8f3e-c249b42c461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:10.308997 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 488/969] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:10.651297 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c023323-e26d-475e-8d0a-99d08fbe9b0b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:10.658713 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c023323-e26d-475e-8d0a-99d08fbe9b0b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:10.662282 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f69d7-7fab-48f6-9807-e742cd466c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:10.662890 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f69d7-7fab-48f6-9807-e742cd466c6d service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:10.663172 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f69d7-7fab-48f6-9807-e742cd466c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:10.663446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f69d7-7fab-48f6-9807-e742cd466c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:10.674035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f69d7-7fab-48f6-9807-e742cd466c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:10.676434 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f69d7-7fab-48f6-9807-e742cd466c6d service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:10.687892 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 482/970] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:19:16.103603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53fa8f-41a0-4e4f-8f5e-b4150419836c None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:16.104126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53fa8f-41a0-4e4f-8f5e-b4150419836c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:16.104126 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53fa8f-41a0-4e4f-8f5e-b4150419836c None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:16.105985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 489/971] 10.222.0.66 () {54 vars in 921 bytes} [Wed Sep 14 15:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:16.121734 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e7be9-6725-42f8-b145-51cbf1789858 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:16.123146 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e7be9-6725-42f8-b145-51cbf1789858 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:16.129479 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e7be9-6725-42f8-b145-51cbf1789858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:16.213898 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-712e7be9-6725-42f8-b145-51cbf1789858 None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:16.215965 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-712e7be9-6725-42f8-b145-51cbf1789858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:16.296627 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 483/972] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Sep 14 15:19:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:20.294997 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=8 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:20.837016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf6e7-7213-4b21-b89e-f2238efd348a None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:20.837370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf6e7-7213-4b21-b89e-f2238efd348a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:20.837606 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf6e7-7213-4b21-b89e-f2238efd348a None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:20.839125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 490/973] 10.222.0.66 () {54 vars in 921 bytes} [Wed Sep 14 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:20.845017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c112f-b05c-45c4-a8d7-dd7f5d7956f5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:20.845529 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c112f-b05c-45c4-a8d7-dd7f5d7956f5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:20.845635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c112f-b05c-45c4-a8d7-dd7f5d7956f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:20.866968 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-510c112f-b05c-45c4-a8d7-dd7f5d7956f5 None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:20.868469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-510c112f-b05c-45c4-a8d7-dd7f5d7956f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:20.878257 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 484/974] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Sep 14 15:19:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:22.337359 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0c6b-bca7-4154-afca-1264e8442731 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:22.338038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0c6b-bca7-4154-afca-1264e8442731 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:22.338038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0c6b-bca7-4154-afca-1264e8442731 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:22.339461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 491/975] 10.222.0.66 () {54 vars in 921 bytes} [Wed Sep 14 15:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:22.345322 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c566c-6906-4b68-961c-5fa2e0173108 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:22.345834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c566c-6906-4b68-961c-5fa2e0173108 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:22.345942 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c566c-6906-4b68-961c-5fa2e0173108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:22.367622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-289c566c-6906-4b68-961c-5fa2e0173108 None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:22.368832 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-289c566c-6906-4b68-961c-5fa2e0173108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:22.377630 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 485/976] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Sep 14 15:19:22 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:26.549770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d6d91-18b0-44df-8e86-fc26fea83927 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:26.550298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d6d91-18b0-44df-8e86-fc26fea83927 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:26.550298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d6d91-18b0-44df-8e86-fc26fea83927 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:26.551768 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 492/977] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:26.556740 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67306417-2f7e-471f-ab36-75a54588ee63 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:26.557487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67306417-2f7e-471f-ab36-75a54588ee63 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:26.557487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67306417-2f7e-471f-ab36-75a54588ee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:26.579440 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-67306417-2f7e-471f-ab36-75a54588ee63 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:26.580744 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-67306417-2f7e-471f-ab36-75a54588ee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:26.589086 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 486/978] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:26.955174 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816db8f-13a0-47e9-8b1f-bfef6e67f830 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:26.955775 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816db8f-13a0-47e9-8b1f-bfef6e67f830 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:26.956614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816db8f-13a0-47e9-8b1f-bfef6e67f830 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:26.958543 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 493/979] 10.222.0.66 () {54 vars in 962 bytes} [Wed Sep 14 15:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:26.968485 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23de8-67f8-495e-b9c9-c06f3b4b4120 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:26.969160 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23de8-67f8-495e-b9c9-c06f3b4b4120 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:26.969754 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23de8-67f8-495e-b9c9-c06f3b4b4120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:27.015414 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c1b23de8-67f8-495e-b9c9-c06f3b4b4120 None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:27.016625 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c1b23de8-67f8-495e-b9c9-c06f3b4b4120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:27.092403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:27.100466 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 487/980] 10.222.0.66 () {58 vars in 1059 bytes} [Wed Sep 14 15:19:26 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:19:27.108644 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816db8f-13a0-47e9-8b1f-bfef6e67f830 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:27.122517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816db8f-13a0-47e9-8b1f-bfef6e67f830 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:27.127409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b3b2a-f8ad-49c8-a93a-d88981ba2785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:27.128011 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3b2a-f8ad-49c8-a93a-d88981ba2785 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:27.128291 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3b2a-f8ad-49c8-a93a-d88981ba2785 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:27.128562 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3b2a-f8ad-49c8-a93a-d88981ba2785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:27.138178 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b3b2a-f8ad-49c8-a93a-d88981ba2785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:27.139819 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b3b2a-f8ad-49c8-a93a-d88981ba2785 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:27.151576 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 494/981] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:29.787833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7c21f-661c-4e56-a8dd-b50cf97d1b0d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:29.788403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7c21f-661c-4e56-a8dd-b50cf97d1b0d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:29.788403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7c21f-661c-4e56-a8dd-b50cf97d1b0d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:29.789756 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 488/982] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:29.795705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11ad8-7b35-4c03-afc1-20d9901564e2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:29.796181 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11ad8-7b35-4c03-afc1-20d9901564e2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:29.796287 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11ad8-7b35-4c03-afc1-20d9901564e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:29.817845 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f1d11ad8-7b35-4c03-afc1-20d9901564e2 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:29.819159 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f1d11ad8-7b35-4c03-afc1-20d9901564e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:29.828659 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 495/983] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:30.168384 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7c21f-661c-4e56-a8dd-b50cf97d1b0d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:30.182901 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7c21f-661c-4e56-a8dd-b50cf97d1b0d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:30.187994 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81add1a-8932-4225-98af-199277d8c60b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:30.188566 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81add1a-8932-4225-98af-199277d8c60b service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:30.188852 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81add1a-8932-4225-98af-199277d8c60b service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:30.189091 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81add1a-8932-4225-98af-199277d8c60b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:30.197552 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81add1a-8932-4225-98af-199277d8c60b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:30.199575 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81add1a-8932-4225-98af-199277d8c60b service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:30.221879 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 489/984] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:33.025285 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef104e1e-0383-4088-b473-e78560455e57 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:33.026088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef104e1e-0383-4088-b473-e78560455e57 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:33.026547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef104e1e-0383-4088-b473-e78560455e57 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:33.028571 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 496/985] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:33.034326 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6606-65c1-4857-934f-368a368849c4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:33.034766 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6606-65c1-4857-934f-368a368849c4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:33.035101 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6606-65c1-4857-934f-368a368849c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:33.057267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-636e6606-65c1-4857-934f-368a368849c4 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:33.058625 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-636e6606-65c1-4857-934f-368a368849c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:33.075974 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 490/986] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:33.414400 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ade7-58d5-42b3-8de4-e947e3980cbc None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:33.414683 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ade7-58d5-42b3-8de4-e947e3980cbc None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:33.414954 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047ade7-58d5-42b3-8de4-e947e3980cbc None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:33.416278 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 497/987] 10.222.0.66 () {54 vars in 962 bytes} [Wed Sep 14 15:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:33.423400 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787de3e4-c86f-4839-8e68-6635e891c9d6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:33.423688 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787de3e4-c86f-4839-8e68-6635e891c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:33.423965 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787de3e4-c86f-4839-8e68-6635e891c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:33.449077 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-787de3e4-c86f-4839-8e68-6635e891c9d6 None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:33.450851 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-787de3e4-c86f-4839-8e68-6635e891c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:33.460941 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 491/988] 10.222.0.66 () {58 vars in 1059 bytes} [Wed Sep 14 15:19:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:33.469884 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047ade7-58d5-42b3-8de4-e947e3980cbc None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:33.485663 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047ade7-58d5-42b3-8de4-e947e3980cbc None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:33.491362 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58b648-17b4-41e8-a9d2-7a88fd62bc38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:33.492072 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b648-17b4-41e8-a9d2-7a88fd62bc38 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:33.492355 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b648-17b4-41e8-a9d2-7a88fd62bc38 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:33.492632 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b648-17b4-41e8-a9d2-7a88fd62bc38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:33.502053 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58b648-17b4-41e8-a9d2-7a88fd62bc38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:33.503642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58b648-17b4-41e8-a9d2-7a88fd62bc38 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:33.516132 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 498/989] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:36.161351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdc3b5-03ab-4f74-8984-ad14781f3457 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:36.161866 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdc3b5-03ab-4f74-8984-ad14781f3457 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:36.161866 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdc3b5-03ab-4f74-8984-ad14781f3457 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:36.167267 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 492/990] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:36.179170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632696-2249-499e-9f68-911844bf4f2c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:36.180623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632696-2249-499e-9f68-911844bf4f2c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:36.181083 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632696-2249-499e-9f68-911844bf4f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:36.214751 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ad632696-2249-499e-9f68-911844bf4f2c None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:36.218774 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ad632696-2249-499e-9f68-911844bf4f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:36.244981 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 499/991] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:36.765813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdc3b5-03ab-4f74-8984-ad14781f3457 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:36.784570 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdc3b5-03ab-4f74-8984-ad14781f3457 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:36.799128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33896795-a1b8-4eb6-951e-dfd3f32b6582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:36.799986 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33896795-a1b8-4eb6-951e-dfd3f32b6582 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:36.800431 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33896795-a1b8-4eb6-951e-dfd3f32b6582 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:36.800847 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33896795-a1b8-4eb6-951e-dfd3f32b6582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:36.810296 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33896795-a1b8-4eb6-951e-dfd3f32b6582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:36.812079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33896795-a1b8-4eb6-951e-dfd3f32b6582 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:36.822445 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 493/992] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:36.860584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ea1f7-5911-44ba-b599-9b723f05da02 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:36.860873 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ea1f7-5911-44ba-b599-9b723f05da02 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:36.861149 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ea1f7-5911-44ba-b599-9b723f05da02 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:36.862526 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 500/993] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:36.868079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c2b6f-4eed-4055-afa8-ff4b649d30ad None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:36.868394 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c2b6f-4eed-4055-afa8-ff4b649d30ad None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:36.868674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c2b6f-4eed-4055-afa8-ff4b649d30ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:36.900765 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-139c2b6f-4eed-4055-afa8-ff4b649d30ad None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:36.900765 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-139c2b6f-4eed-4055-afa8-ff4b649d30ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:36.900765 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 494/994] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:37.259454 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c334-2aec-4a77-8ea8-cd5add4e4534 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:37.259868 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c334-2aec-4a77-8ea8-cd5add4e4534 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:37.260087 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c334-2aec-4a77-8ea8-cd5add4e4534 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:37.261657 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 501/995] 10.222.0.66 () {54 vars in 964 bytes} [Wed Sep 14 15:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:37.267667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86985-836a-42f1-b446-726f99657bda None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:37.268141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86985-836a-42f1-b446-726f99657bda None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:37.268238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f86985-836a-42f1-b446-726f99657bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:37.307773 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-95f86985-836a-42f1-b446-726f99657bda None None] MFA Rules not processed for user `58b3ed4fedd54add9680e2968db68b71`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:37.309914 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-95f86985-836a-42f1-b446-726f99657bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:37.374623 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 495/996] 10.222.0.66 () {58 vars in 1061 bytes} [Wed Sep 14 15:19:37 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:37.382918 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0c334-2aec-4a77-8ea8-cd5add4e4534 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:37.399584 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0c334-2aec-4a77-8ea8-cd5add4e4534 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:37.403357 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c18a89-0fab-4dbc-81c8-c6380fe31447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b3ed4fedd54add9680e2968db68b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:37.404018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c18a89-0fab-4dbc-81c8-c6380fe31447 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:37.404603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c18a89-0fab-4dbc-81c8-c6380fe31447 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:37.404883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c18a89-0fab-4dbc-81c8-c6380fe31447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:37.414494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c18a89-0fab-4dbc-81c8-c6380fe31447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:37.415926 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c18a89-0fab-4dbc-81c8-c6380fe31447 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:37.425601 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 502/997] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:19:39.292587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15979-c6d4-448a-9bbf-5316faf3ff02 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:39.293140 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15979-c6d4-448a-9bbf-5316faf3ff02 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:39.293140 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15979-c6d4-448a-9bbf-5316faf3ff02 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:39.295095 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 496/998] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:39.301022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcee11-b6de-4cc0-8b8f-e3363b6f00b2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:39.301597 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcee11-b6de-4cc0-8b8f-e3363b6f00b2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:39.301711 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcee11-b6de-4cc0-8b8f-e3363b6f00b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:39.322747 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a6fcee11-b6de-4cc0-8b8f-e3363b6f00b2 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:39.324006 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a6fcee11-b6de-4cc0-8b8f-e3363b6f00b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:39.332240 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 503/999] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:39.677306 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15979-c6d4-448a-9bbf-5316faf3ff02 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:39.691401 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15979-c6d4-448a-9bbf-5316faf3ff02 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:39.696516 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faa2c6-4e1c-4a26-b404-31fa66d49221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:39.697119 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faa2c6-4e1c-4a26-b404-31fa66d49221 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:39.697502 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faa2c6-4e1c-4a26-b404-31fa66d49221 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:39.697810 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faa2c6-4e1c-4a26-b404-31fa66d49221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:39.706908 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faa2c6-4e1c-4a26-b404-31fa66d49221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:39.708495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faa2c6-4e1c-4a26-b404-31fa66d49221 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:39.718677 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 497/1000] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:42.283367 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381813-3cff-4c66-aff9-81ff2edc106f None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:42.283930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381813-3cff-4c66-aff9-81ff2edc106f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:42.283930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381813-3cff-4c66-aff9-81ff2edc106f None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:42.285225 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 504/1001] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:42.290622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af5a-70c7-4991-9f4b-6b46160b1359 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:42.291065 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af5a-70c7-4991-9f4b-6b46160b1359 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:42.291179 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421af5a-70c7-4991-9f4b-6b46160b1359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:42.321576 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9421af5a-70c7-4991-9f4b-6b46160b1359 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:42.322799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9421af5a-70c7-4991-9f4b-6b46160b1359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:42.331090 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 498/1002] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:42.678846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43381813-3cff-4c66-aff9-81ff2edc106f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:42.693097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43381813-3cff-4c66-aff9-81ff2edc106f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:42.698152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47a48c-c27d-4306-ac2d-b55eeecece65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:42.698750 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47a48c-c27d-4306-ac2d-b55eeecece65 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:42.699031 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47a48c-c27d-4306-ac2d-b55eeecece65 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:42.699300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47a48c-c27d-4306-ac2d-b55eeecece65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:42.707750 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47a48c-c27d-4306-ac2d-b55eeecece65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:42.709445 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47a48c-c27d-4306-ac2d-b55eeecece65 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:42.719612 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 505/1003] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:45.180778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c2089-a0aa-4501-9d60-bf9d71f831a8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:45.181508 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c2089-a0aa-4501-9d60-bf9d71f831a8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:45.181508 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c2089-a0aa-4501-9d60-bf9d71f831a8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:45.182691 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 499/1004] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:45.188484 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73ce8-de48-4f1b-81ad-839671cfaaa6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:45.188891 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73ce8-de48-4f1b-81ad-839671cfaaa6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:45.189047 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73ce8-de48-4f1b-81ad-839671cfaaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:45.209712 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-12a73ce8-de48-4f1b-81ad-839671cfaaa6 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:45.210993 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-12a73ce8-de48-4f1b-81ad-839671cfaaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:45.220181 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 506/1005] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:45.567723 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c2089-a0aa-4501-9d60-bf9d71f831a8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:45.583518 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c2089-a0aa-4501-9d60-bf9d71f831a8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:45.591743 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20873-ebcd-4e47-a9e3-8f6c85c15fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:45.592425 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20873-ebcd-4e47-a9e3-8f6c85c15fe2 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:45.592658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20873-ebcd-4e47-a9e3-8f6c85c15fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:45.592947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20873-ebcd-4e47-a9e3-8f6c85c15fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:45.601878 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd20873-ebcd-4e47-a9e3-8f6c85c15fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:45.603647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd20873-ebcd-4e47-a9e3-8f6c85c15fe2 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:45.617610 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 500/1006] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:48.329137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719271d0-ded3-4506-8b4a-320f072a5e40 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:48.329681 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719271d0-ded3-4506-8b4a-320f072a5e40 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:48.329903 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719271d0-ded3-4506-8b4a-320f072a5e40 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:48.331802 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 507/1007] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:48.336799 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658c1d-b735-4811-8474-ca4182b7ac74 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:48.337246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658c1d-b735-4811-8474-ca4182b7ac74 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:48.337376 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf658c1d-b735-4811-8474-ca4182b7ac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:48.357674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-cf658c1d-b735-4811-8474-ca4182b7ac74 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:48.358878 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cf658c1d-b735-4811-8474-ca4182b7ac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:48.366755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 501/1008] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:48.716848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719271d0-ded3-4506-8b4a-320f072a5e40 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:48.733735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719271d0-ded3-4506-8b4a-320f072a5e40 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:48.739373 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d528d6-0f51-40af-8dad-c8e0df33ae92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:48.739976 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d528d6-0f51-40af-8dad-c8e0df33ae92 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:48.740257 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d528d6-0f51-40af-8dad-c8e0df33ae92 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:48.740523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d528d6-0f51-40af-8dad-c8e0df33ae92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:48.748758 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d528d6-0f51-40af-8dad-c8e0df33ae92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:48.750356 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d528d6-0f51-40af-8dad-c8e0df33ae92 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:48.761736 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 508/1009] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:51.974479 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5875e-6fc4-4665-89b5-e49f762455a9 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:51.975488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5875e-6fc4-4665-89b5-e49f762455a9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:51.975488 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5875e-6fc4-4665-89b5-e49f762455a9 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:51.977203 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 502/1010] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:51.983572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e35c2-4220-4afc-8f3f-b695599bb783 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:51.984055 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e35c2-4220-4afc-8f3f-b695599bb783 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:51.984204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e35c2-4220-4afc-8f3f-b695599bb783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:51.992107 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=43 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:52.005087 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8f4e35c2-4220-4afc-8f3f-b695599bb783 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:52.006306 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8f4e35c2-4220-4afc-8f3f-b695599bb783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:52.014433 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 509/1011] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:52.357853 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5875e-6fc4-4665-89b5-e49f762455a9 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:52.371156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5875e-6fc4-4665-89b5-e49f762455a9 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:52.376097 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a8129-46f7-4334-a380-edb04150ad6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:52.376692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a8129-46f7-4334-a380-edb04150ad6b service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:52.376972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a8129-46f7-4334-a380-edb04150ad6b service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:52.377242 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a8129-46f7-4334-a380-edb04150ad6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:52.387536 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a8129-46f7-4334-a380-edb04150ad6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:52.389184 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a8129-46f7-4334-a380-edb04150ad6b service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:52.399867 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 503/1012] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:53.740076 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e2b9-1fd8-4e8c-a674-c567d09c7602 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:53.740679 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e2b9-1fd8-4e8c-a674-c567d09c7602 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:53.740679 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e2b9-1fd8-4e8c-a674-c567d09c7602 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:53.742054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 510/1013] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:53.748031 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94ae3c-c967-489d-9220-822ff212a78e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:53.748497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94ae3c-c967-489d-9220-822ff212a78e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:53.748618 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94ae3c-c967-489d-9220-822ff212a78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:53.770555 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7d94ae3c-c967-489d-9220-822ff212a78e None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:53.771768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7d94ae3c-c967-489d-9220-822ff212a78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:53.779510 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 504/1014] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:54.138966 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cb94-25a7-4990-bb3e-6875d6987752 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:54.139324 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cb94-25a7-4990-bb3e-6875d6987752 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:54.139663 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cb94-25a7-4990-bb3e-6875d6987752 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:54.141057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 511/1015] 10.222.0.66 () {54 vars in 966 bytes} [Wed Sep 14 15:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:54.146357 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575145a-54af-4ba7-a46c-ba9a4793d910 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:54.146712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575145a-54af-4ba7-a46c-ba9a4793d910 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:54.147054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575145a-54af-4ba7-a46c-ba9a4793d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:54.187974 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6575145a-54af-4ba7-a46c-ba9a4793d910 None None] MFA Rules not processed for user `8d18577a8ba44017b686ddf1149e0244`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:54.189174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6575145a-54af-4ba7-a46c-ba9a4793d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:54.209217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:19:54.249676 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 505/1016] 10.222.0.66 () {58 vars in 1063 bytes} [Wed Sep 14 15:19:54 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:54.257688 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4cb94-25a7-4990-bb3e-6875d6987752 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:54.268681 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4cb94-25a7-4990-bb3e-6875d6987752 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:54.272244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4e4d1-aa97-44a2-a682-46a0ef53f6a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d18577a8ba44017b686ddf1149e0244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:54.272908 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4e4d1-aa97-44a2-a682-46a0ef53f6a8 service glance] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:54.273192 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4e4d1-aa97-44a2-a682-46a0ef53f6a8 service glance] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:54.273487 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4e4d1-aa97-44a2-a682-46a0ef53f6a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:54.283950 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4e4d1-aa97-44a2-a682-46a0ef53f6a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:54.285414 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4e4d1-aa97-44a2-a682-46a0ef53f6a8 service glance] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:54.295721 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 512/1017] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:54.891809 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f0322-66bd-4107-b9e1-8e46b9a6df51 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:54.892416 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f0322-66bd-4107-b9e1-8e46b9a6df51 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:54.892416 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f0322-66bd-4107-b9e1-8e46b9a6df51 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:54.893910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 506/1018] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:54.899352 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9004e49-f334-47a8-9e6d-8bcf11c42590 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:54.899836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9004e49-f334-47a8-9e6d-8bcf11c42590 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:54.899940 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9004e49-f334-47a8-9e6d-8bcf11c42590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:54.919716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f9004e49-f334-47a8-9e6d-8bcf11c42590 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:54.920938 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f9004e49-f334-47a8-9e6d-8bcf11c42590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:54.930168 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 513/1019] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:55.283994 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f0322-66bd-4107-b9e1-8e46b9a6df51 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:55.299807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f0322-66bd-4107-b9e1-8e46b9a6df51 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:55.305054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1c003-f662-45c0-9551-a14ca779beab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:55.305701 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c003-f662-45c0-9551-a14ca779beab service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:55.305987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c003-f662-45c0-9551-a14ca779beab service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:55.306265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c003-f662-45c0-9551-a14ca779beab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:55.315774 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1c003-f662-45c0-9551-a14ca779beab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:55.317424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1c003-f662-45c0-9551-a14ca779beab service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:55.328571 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 507/1020] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:19:57.978608 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41633-468a-469d-8773-721c4bc02ee3 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:57.979280 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41633-468a-469d-8773-721c4bc02ee3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:57.979280 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41633-468a-469d-8773-721c4bc02ee3 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:57.981172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 514/1021] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:19:57.986552 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b84c5-f72a-4cb2-81ba-7a8bdfad6b7f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:57.987008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b84c5-f72a-4cb2-81ba-7a8bdfad6b7f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:57.987160 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b84c5-f72a-4cb2-81ba-7a8bdfad6b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:58.010754 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-071b84c5-f72a-4cb2-81ba-7a8bdfad6b7f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:19:58.012750 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-071b84c5-f72a-4cb2-81ba-7a8bdfad6b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:19:58.019644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 508/1022] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:19:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:19:58.366404 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d41633-468a-469d-8773-721c4bc02ee3 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:19:58.382385 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d41633-468a-469d-8773-721c4bc02ee3 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:19:58.388189 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad83f-fee6-4639-b83b-25ef69a92ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:19:58.388797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad83f-fee6-4639-b83b-25ef69a92ff0 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:19:58.389079 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad83f-fee6-4639-b83b-25ef69a92ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:19:58.389385 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad83f-fee6-4639-b83b-25ef69a92ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:19:58.398277 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ad83f-fee6-4639-b83b-25ef69a92ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:19:58.399880 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ad83f-fee6-4639-b83b-25ef69a92ff0 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:19:58.410870 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 515/1023] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:19:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:01.108148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391071f-f25f-4174-9ae6-8a67a6203598 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:01.108759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391071f-f25f-4174-9ae6-8a67a6203598 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:01.108759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391071f-f25f-4174-9ae6-8a67a6203598 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:01.110190 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 509/1024] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:01.115834 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aec01a-9e1e-4b7e-b829-fd34af0c45da None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:01.116391 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aec01a-9e1e-4b7e-b829-fd34af0c45da None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:01.116500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aec01a-9e1e-4b7e-b829-fd34af0c45da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:01.137713 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-72aec01a-9e1e-4b7e-b829-fd34af0c45da None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:01.139517 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-72aec01a-9e1e-4b7e-b829-fd34af0c45da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:01.147587 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 516/1025] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:20:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:01.492072 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391071f-f25f-4174-9ae6-8a67a6203598 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:01.511068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391071f-f25f-4174-9ae6-8a67a6203598 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:01.516227 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f833d-465c-4d0c-804e-225e02c8802d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:01.516854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f833d-465c-4d0c-804e-225e02c8802d service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:01.517133 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f833d-465c-4d0c-804e-225e02c8802d service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:01.517453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f833d-465c-4d0c-804e-225e02c8802d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:01.526806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f833d-465c-4d0c-804e-225e02c8802d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:01.528443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f833d-465c-4d0c-804e-225e02c8802d service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:01.539692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 510/1026] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:09.831092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad4bc-2290-4431-b1fc-a5c6f2ed85cf None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:09.831676 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad4bc-2290-4431-b1fc-a5c6f2ed85cf None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:09.831676 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad4bc-2290-4431-b1fc-a5c6f2ed85cf None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:09.833082 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 517/1027] 10.222.0.66 () {54 vars in 918 bytes} [Wed Sep 14 15:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:09.838325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd949c6-c1c4-44b8-b0f7-86def1fdd143 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:09.838749 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd949c6-c1c4-44b8-b0f7-86def1fdd143 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:09.838870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd949c6-c1c4-44b8-b0f7-86def1fdd143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:09.859028 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-edd949c6-c1c4-44b8-b0f7-86def1fdd143 None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:09.860228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-edd949c6-c1c4-44b8-b0f7-86def1fdd143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:09.868724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 511/1028] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Sep 14 15:20:09 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:09.883923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68244-4e9c-411f-964a-d895b3b36e40 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:09.884205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68244-4e9c-411f-964a-d895b3b36e40 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:09.884561 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68244-4e9c-411f-964a-d895b3b36e40 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:09.885916 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 518/1029] 10.222.0.66 () {54 vars in 918 bytes} [Wed Sep 14 15:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:09.890854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402692d-0c2b-4ee4-bd02-5cc22c771dcd None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:09.891144 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402692d-0c2b-4ee4-bd02-5cc22c771dcd None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:09.891423 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402692d-0c2b-4ee4-bd02-5cc22c771dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:09.911280 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3402692d-0c2b-4ee4-bd02-5cc22c771dcd None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:09.912491 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3402692d-0c2b-4ee4-bd02-5cc22c771dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:09.921603 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 512/1030] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Sep 14 15:20:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:11.131394 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=20 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:12.829858 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaaa4d-5295-4b0f-a22e-7201681f1e11 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:12.830574 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaaa4d-5295-4b0f-a22e-7201681f1e11 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:12.830574 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaaa4d-5295-4b0f-a22e-7201681f1e11 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:12.831750 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 519/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:12.837149 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246eb7-737b-4110-99bd-3ce9c7e3f42d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:12.837782 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246eb7-737b-4110-99bd-3ce9c7e3f42d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:12.837782 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30246eb7-737b-4110-99bd-3ce9c7e3f42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:12.857886 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-30246eb7-737b-4110-99bd-3ce9c7e3f42d None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:12.859079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-30246eb7-737b-4110-99bd-3ce9c7e3f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:12.866781 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 513/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:13.240847 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaaa4d-5295-4b0f-a22e-7201681f1e11 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:13.254117 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaaa4d-5295-4b0f-a22e-7201681f1e11 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:13.259196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275e9f-cc12-4289-8310-c186201ea9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:13.259786 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275e9f-cc12-4289-8310-c186201ea9b5 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:13.260064 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275e9f-cc12-4289-8310-c186201ea9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:13.260335 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275e9f-cc12-4289-8310-c186201ea9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:13.269115 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275e9f-cc12-4289-8310-c186201ea9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:13.270731 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275e9f-cc12-4289-8310-c186201ea9b5 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:13.280707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 520/1033] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:14.979437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eaaf1-7a9c-49fd-83ee-d677d6a5ab78 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:14.980023 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eaaf1-7a9c-49fd-83ee-d677d6a5ab78 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:14.980023 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eaaf1-7a9c-49fd-83ee-d677d6a5ab78 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:14.981382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 514/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:14.986235 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2924-a188-426a-9396-de15ba468851 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:14.986656 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2924-a188-426a-9396-de15ba468851 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:14.986784 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2924-a188-426a-9396-de15ba468851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:15.005804 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f61c2924-a188-426a-9396-de15ba468851 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:15.006974 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f61c2924-a188-426a-9396-de15ba468851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:15.015787 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 521/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:20:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:15.229541 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eaaf1-7a9c-49fd-83ee-d677d6a5ab78 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:15.242955 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eaaf1-7a9c-49fd-83ee-d677d6a5ab78 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:15.248343 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91505361-cb5f-411e-8041-71901c617bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:15.248938 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505361-cb5f-411e-8041-71901c617bae service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:15.249220 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505361-cb5f-411e-8041-71901c617bae service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:15.249532 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505361-cb5f-411e-8041-71901c617bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:15.257776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91505361-cb5f-411e-8041-71901c617bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:15.259372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91505361-cb5f-411e-8041-71901c617bae service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:15.269328 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 515/1036] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:16.965878 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6083-6a42-4e76-b74f-f34641947a41 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:16.966430 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6083-6a42-4e76-b74f-f34641947a41 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:16.966430 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6083-6a42-4e76-b74f-f34641947a41 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:16.967782 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 522/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:16.972703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c684bb-709a-4b53-9e76-1f4fae2a6a5f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:16.973083 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c684bb-709a-4b53-9e76-1f4fae2a6a5f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:16.973287 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c684bb-709a-4b53-9e76-1f4fae2a6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:16.994070 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-00c684bb-709a-4b53-9e76-1f4fae2a6a5f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:16.996066 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-00c684bb-709a-4b53-9e76-1f4fae2a6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:17.004008 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 516/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:20:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:17.162845 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b6083-6a42-4e76-b74f-f34641947a41 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:17.176933 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b6083-6a42-4e76-b74f-f34641947a41 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:17.181778 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f26c-e890-4060-a944-0c655ce9349a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:17.182366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f26c-e890-4060-a944-0c655ce9349a service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:17.183258 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f26c-e890-4060-a944-0c655ce9349a service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:17.183526 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f26c-e890-4060-a944-0c655ce9349a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:17.191421 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f26c-e890-4060-a944-0c655ce9349a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:17.192985 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f26c-e890-4060-a944-0c655ce9349a service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:17.202077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 523/1039] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:18.862068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8fd7-1b60-4ed4-a76c-1577af5a6b94 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:18.862635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8fd7-1b60-4ed4-a76c-1577af5a6b94 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:18.862635 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8fd7-1b60-4ed4-a76c-1577af5a6b94 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:18.863975 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 517/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:18.868903 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0581-4087-4e7f-8825-2042eb43f8d2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:18.869304 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0581-4087-4e7f-8825-2042eb43f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:18.869481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0581-4087-4e7f-8825-2042eb43f8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:18.888743 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a06a0581-4087-4e7f-8825-2042eb43f8d2 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:18.889971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a06a0581-4087-4e7f-8825-2042eb43f8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:18.897659 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 524/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:20:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:19.053947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b8fd7-1b60-4ed4-a76c-1577af5a6b94 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:19.067245 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b8fd7-1b60-4ed4-a76c-1577af5a6b94 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:19.072182 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ac8d2-9104-47ff-873b-c9195a22b784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:19.072771 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac8d2-9104-47ff-873b-c9195a22b784 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:19.073081 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac8d2-9104-47ff-873b-c9195a22b784 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:19.073387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac8d2-9104-47ff-873b-c9195a22b784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:19.081301 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ac8d2-9104-47ff-873b-c9195a22b784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:19.082905 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ac8d2-9104-47ff-873b-c9195a22b784 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:19.092646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 518/1042] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:20.747170 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6666-cb5e-4d5a-8a28-52784120c492 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:20.747739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6666-cb5e-4d5a-8a28-52784120c492 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:20.747739 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6666-cb5e-4d5a-8a28-52784120c492 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:20.749051 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 525/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:20.753842 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbde71-0558-4e9e-ad59-b11b30907370 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:20.754227 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbde71-0558-4e9e-ad59-b11b30907370 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:20.754409 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbde71-0558-4e9e-ad59-b11b30907370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:20.774821 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-40bbde71-0558-4e9e-ad59-b11b30907370 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:20.776137 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-40bbde71-0558-4e9e-ad59-b11b30907370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:20.784685 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 519/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:20:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:20.940539 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6666-cb5e-4d5a-8a28-52784120c492 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:20.954323 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6666-cb5e-4d5a-8a28-52784120c492 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:20.959230 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0f926-033f-4ab9-a72e-9913d6a8c277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:20.959823 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f926-033f-4ab9-a72e-9913d6a8c277 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:20.960104 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f926-033f-4ab9-a72e-9913d6a8c277 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:20.960378 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f926-033f-4ab9-a72e-9913d6a8c277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:20.968894 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0f926-033f-4ab9-a72e-9913d6a8c277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:20.970507 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0f926-033f-4ab9-a72e-9913d6a8c277 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:20.979730 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 526/1045] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:22.574843 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550da0d7-4231-45b2-98d8-65990d921ed8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:22.575350 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550da0d7-4231-45b2-98d8-65990d921ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:22.575350 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550da0d7-4231-45b2-98d8-65990d921ed8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:22.576653 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 520/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:22.581422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a5f6-cb00-490c-b3fd-5a29c1dfd56f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:22.581846 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a5f6-cb00-490c-b3fd-5a29c1dfd56f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:22.581984 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a5f6-cb00-490c-b3fd-5a29c1dfd56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:22.601150 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-edc2a5f6-cb00-490c-b3fd-5a29c1dfd56f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:22.602374 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-edc2a5f6-cb00-490c-b3fd-5a29c1dfd56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:22.610210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 527/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:20:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:22.771171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550da0d7-4231-45b2-98d8-65990d921ed8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:22.784707 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550da0d7-4231-45b2-98d8-65990d921ed8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:22.789743 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aac20-a89c-4ab8-b280-5d557cece18c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:22.790254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aac20-a89c-4ab8-b280-5d557cece18c service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:22.790560 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aac20-a89c-4ab8-b280-5d557cece18c service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:22.790834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aac20-a89c-4ab8-b280-5d557cece18c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:22.798714 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aac20-a89c-4ab8-b280-5d557cece18c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:22.800274 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aac20-a89c-4ab8-b280-5d557cece18c service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:22.809957 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 521/1048] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:24.401139 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044104ea-91c7-4c56-af23-4629ecd65551 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:24.401706 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044104ea-91c7-4c56-af23-4629ecd65551 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:24.401822 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044104ea-91c7-4c56-af23-4629ecd65551 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:24.403088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 528/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:24.407824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6e28-7691-42c0-80fb-1f8ec367d91d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:24.408280 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6e28-7691-42c0-80fb-1f8ec367d91d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:24.408395 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6e28-7691-42c0-80fb-1f8ec367d91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:24.415943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=64 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:24.428819 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-817e6e28-7691-42c0-80fb-1f8ec367d91d None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:24.430108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-817e6e28-7691-42c0-80fb-1f8ec367d91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:24.438366 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 522/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:20:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:24.595890 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044104ea-91c7-4c56-af23-4629ecd65551 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:24.609478 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044104ea-91c7-4c56-af23-4629ecd65551 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:24.614340 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb6555-a463-4878-9a01-900682b4bc1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:24.614927 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6555-a463-4878-9a01-900682b4bc1b service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:24.615203 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6555-a463-4878-9a01-900682b4bc1b service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:24.615473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6555-a463-4878-9a01-900682b4bc1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:24.623931 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb6555-a463-4878-9a01-900682b4bc1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:24.625529 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb6555-a463-4878-9a01-900682b4bc1b service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:24.634790 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 529/1051] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:26.246327 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381d09-28b3-4963-a4a2-2985824454df None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:26.246928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381d09-28b3-4963-a4a2-2985824454df None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:26.246928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381d09-28b3-4963-a4a2-2985824454df None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:26.248216 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 523/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:26.253027 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4fae-6d01-4453-8537-cb0629c89502 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:26.253493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4fae-6d01-4453-8537-cb0629c89502 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:26.253623 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4fae-6d01-4453-8537-cb0629c89502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:26.272748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ca6a4fae-6d01-4453-8537-cb0629c89502 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:26.273971 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ca6a4fae-6d01-4453-8537-cb0629c89502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:26.281574 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 530/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:20:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:20:26.439048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22381d09-28b3-4963-a4a2-2985824454df None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:26.452856 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22381d09-28b3-4963-a4a2-2985824454df None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:26.458180 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625f488-18bb-45c8-a88c-3059df9f6c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:26.458776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625f488-18bb-45c8-a88c-3059df9f6c8c service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:26.459057 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625f488-18bb-45c8-a88c-3059df9f6c8c service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:26.459360 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625f488-18bb-45c8-a88c-3059df9f6c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:26.467972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625f488-18bb-45c8-a88c-3059df9f6c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:26.469580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625f488-18bb-45c8-a88c-3059df9f6c8c service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:26.478724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 524/1054] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:28.090866 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf44f5-5b29-475f-9ccd-db815391c4a7 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:28.091375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf44f5-5b29-475f-9ccd-db815391c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:28.091375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf44f5-5b29-475f-9ccd-db815391c4a7 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:28.092673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 531/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:28.097497 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54569a-78ca-4507-b3af-c3301cb7a0f0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:28.097926 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54569a-78ca-4507-b3af-c3301cb7a0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:28.098150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54569a-78ca-4507-b3af-c3301cb7a0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:28.117943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-cb54569a-78ca-4507-b3af-c3301cb7a0f0 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:28.119125 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cb54569a-78ca-4507-b3af-c3301cb7a0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:28.126788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 525/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:20:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:28.285188 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf44f5-5b29-475f-9ccd-db815391c4a7 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:28.298218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf44f5-5b29-475f-9ccd-db815391c4a7 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:28.303037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f77e1-83dd-49ed-9118-23fc70f37588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:28.303610 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f77e1-83dd-49ed-9118-23fc70f37588 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:28.303889 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f77e1-83dd-49ed-9118-23fc70f37588 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:28.304158 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f77e1-83dd-49ed-9118-23fc70f37588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:28.312525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f77e1-83dd-49ed-9118-23fc70f37588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:28.314173 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f77e1-83dd-49ed-9118-23fc70f37588 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:28.324828 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 532/1057] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:30.668406 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b0766-eeeb-40bb-98e1-bcba2305a5b5 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:30.669082 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b0766-eeeb-40bb-98e1-bcba2305a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:30.669082 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b0766-eeeb-40bb-98e1-bcba2305a5b5 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:30.670411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 526/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:30.675624 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b4b1-74c7-48a8-89bf-fa6ae55bf879 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:30.676077 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b4b1-74c7-48a8-89bf-fa6ae55bf879 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:30.676184 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b4b1-74c7-48a8-89bf-fa6ae55bf879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:30.695151 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b2f8b4b1-74c7-48a8-89bf-fa6ae55bf879 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:30.696268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b2f8b4b1-74c7-48a8-89bf-fa6ae55bf879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:30.704870 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 533/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:31.043557 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b0766-eeeb-40bb-98e1-bcba2305a5b5 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:31.054065 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b0766-eeeb-40bb-98e1-bcba2305a5b5 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:31.058079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6745f-9259-40ac-b807-175f3f7a7b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:31.058664 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6745f-9259-40ac-b807-175f3f7a7b91 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:31.058941 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6745f-9259-40ac-b807-175f3f7a7b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:31.059208 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6745f-9259-40ac-b807-175f3f7a7b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:31.067755 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6745f-9259-40ac-b807-175f3f7a7b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:31.069167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6745f-9259-40ac-b807-175f3f7a7b91 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:31.078952 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 527/1060] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:33.717360 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09249f1-0c2e-4b3c-bbf9-af999f457e3c None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:33.717928 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09249f1-0c2e-4b3c-bbf9-af999f457e3c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:33.718017 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09249f1-0c2e-4b3c-bbf9-af999f457e3c None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:33.719338 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 534/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:33.724860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0785-ffd8-4faa-b611-3d1e806a1229 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:33.725270 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0785-ffd8-4faa-b611-3d1e806a1229 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:33.725473 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0785-ffd8-4faa-b611-3d1e806a1229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:33.745541 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-259a0785-ffd8-4faa-b611-3d1e806a1229 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:33.746744 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-259a0785-ffd8-4faa-b611-3d1e806a1229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:33.754453 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 528/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:34.089305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09249f1-0c2e-4b3c-bbf9-af999f457e3c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:34.100232 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09249f1-0c2e-4b3c-bbf9-af999f457e3c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:34.104363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484ee9-2c7f-4608-ba0e-94c4a97a84da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:34.104978 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484ee9-2c7f-4608-ba0e-94c4a97a84da service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:34.105248 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484ee9-2c7f-4608-ba0e-94c4a97a84da service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:34.105555 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484ee9-2c7f-4608-ba0e-94c4a97a84da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:34.115196 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484ee9-2c7f-4608-ba0e-94c4a97a84da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:34.116625 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484ee9-2c7f-4608-ba0e-94c4a97a84da service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:34.126185 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 535/1063] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:36.829011 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1db9-a44f-4ac6-9f64-289983d1abce None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:36.829607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1db9-a44f-4ac6-9f64-289983d1abce None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:36.829607 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1db9-a44f-4ac6-9f64-289983d1abce None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:36.830946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 529/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:36.836303 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc047-ec84-45ab-b079-5c358dd5f87f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:36.836725 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc047-ec84-45ab-b079-5c358dd5f87f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:36.836847 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc047-ec84-45ab-b079-5c358dd5f87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:36.857650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f09fc047-ec84-45ab-b079-5c358dd5f87f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:36.858837 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f09fc047-ec84-45ab-b079-5c358dd5f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:36.866484 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 536/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:37.206888 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1db9-a44f-4ac6-9f64-289983d1abce None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:37.218561 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1db9-a44f-4ac6-9f64-289983d1abce None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:37.222069 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75ffe4-eb49-41df-b335-caddc073d956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:37.222665 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ffe4-eb49-41df-b335-caddc073d956 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:37.222947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ffe4-eb49-41df-b335-caddc073d956 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:37.223221 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ffe4-eb49-41df-b335-caddc073d956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:37.232029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75ffe4-eb49-41df-b335-caddc073d956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:37.233487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75ffe4-eb49-41df-b335-caddc073d956 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:37.242751 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 530/1066] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:39.787243 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e0c9-421c-4ba2-829f-2792bd9a314e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:39.787805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e0c9-421c-4ba2-829f-2792bd9a314e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:39.787805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e0c9-421c-4ba2-829f-2792bd9a314e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:39.789140 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 537/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:39.795020 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93454-d0cf-4e80-8eb6-b539db84fd2f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:39.795439 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93454-d0cf-4e80-8eb6-b539db84fd2f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:39.795570 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93454-d0cf-4e80-8eb6-b539db84fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:39.816382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-29b93454-d0cf-4e80-8eb6-b539db84fd2f None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:39.817729 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-29b93454-d0cf-4e80-8eb6-b539db84fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:39.826254 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 531/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:40.163088 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572e0c9-421c-4ba2-829f-2792bd9a314e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:40.174335 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572e0c9-421c-4ba2-829f-2792bd9a314e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:40.177838 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c993e8c-3425-4929-9546-c530c651569c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:40.178433 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993e8c-3425-4929-9546-c530c651569c service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:40.178732 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993e8c-3425-4929-9546-c530c651569c service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:40.178990 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993e8c-3425-4929-9546-c530c651569c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:40.188171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c993e8c-3425-4929-9546-c530c651569c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:40.189651 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c993e8c-3425-4929-9546-c530c651569c service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:40.199662 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 538/1069] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:42.662825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113c81-6431-49f3-a7b8-1eabeeb6a59e None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:42.663359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113c81-6431-49f3-a7b8-1eabeeb6a59e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:42.663359 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113c81-6431-49f3-a7b8-1eabeeb6a59e None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:42.664705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 532/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:42.670545 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4205-2bd0-401d-8901-d233663b6eab None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:42.670946 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4205-2bd0-401d-8901-d233663b6eab None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:42.671096 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4205-2bd0-401d-8901-d233663b6eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:42.678341 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=61 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:42.692001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f4ca4205-2bd0-401d-8901-d233663b6eab None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:42.693201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f4ca4205-2bd0-401d-8901-d233663b6eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:42.700945 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 539/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:43.044370 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed113c81-6431-49f3-a7b8-1eabeeb6a59e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:43.055077 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed113c81-6431-49f3-a7b8-1eabeeb6a59e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:43.058578 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4b3ca-1489-4d0d-9144-8488762545ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:43.059166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4b3ca-1489-4d0d-9144-8488762545ea service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:43.059443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4b3ca-1489-4d0d-9144-8488762545ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:43.059713 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4b3ca-1489-4d0d-9144-8488762545ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:43.068357 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4b3ca-1489-4d0d-9144-8488762545ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:43.069816 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4b3ca-1489-4d0d-9144-8488762545ea service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:43.079053 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 533/1072] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:45.535658 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4f094-e0da-41ab-9217-168e6f52cfa4 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:45.536219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4f094-e0da-41ab-9217-168e6f52cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:45.536219 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4f094-e0da-41ab-9217-168e6f52cfa4 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:45.537614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 540/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:45.542935 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389f7e-2d60-463f-8132-82104732b500 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:45.543351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389f7e-2d60-463f-8132-82104732b500 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:45.543479 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389f7e-2d60-463f-8132-82104732b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:45.562919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-1e389f7e-2d60-463f-8132-82104732b500 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:45.564112 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1e389f7e-2d60-463f-8132-82104732b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:45.571838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 534/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:45.910856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4f094-e0da-41ab-9217-168e6f52cfa4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:45.921696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4f094-e0da-41ab-9217-168e6f52cfa4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:45.925102 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea84c72-eb61-46d1-a686-1c8d0f79c998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:45.925724 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84c72-eb61-46d1-a686-1c8d0f79c998 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:45.926000 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84c72-eb61-46d1-a686-1c8d0f79c998 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:45.926266 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84c72-eb61-46d1-a686-1c8d0f79c998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:45.935824 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea84c72-eb61-46d1-a686-1c8d0f79c998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:45.937243 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea84c72-eb61-46d1-a686-1c8d0f79c998 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:45.946304 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 541/1075] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:48.391902 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d41a7-8e16-47b3-96f6-23fbb25a6c4c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:48.392411 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d41a7-8e16-47b3-96f6-23fbb25a6c4c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:48.392506 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d41a7-8e16-47b3-96f6-23fbb25a6c4c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:48.393832 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 535/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:48.399185 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aee6f1-7386-4be2-90b3-6b8b52d025f3 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:48.399640 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aee6f1-7386-4be2-90b3-6b8b52d025f3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:48.399745 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aee6f1-7386-4be2-90b3-6b8b52d025f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:48.418532 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-59aee6f1-7386-4be2-90b3-6b8b52d025f3 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:48.419715 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-59aee6f1-7386-4be2-90b3-6b8b52d025f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:48.427349 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 542/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:48.768792 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d41a7-8e16-47b3-96f6-23fbb25a6c4c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:48.779362 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d41a7-8e16-47b3-96f6-23fbb25a6c4c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:48.782849 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e21cc-8b68-4a64-9667-e87ec3c72a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:48.783469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e21cc-8b68-4a64-9667-e87ec3c72a6d service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:48.783747 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e21cc-8b68-4a64-9667-e87ec3c72a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:48.784017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e21cc-8b68-4a64-9667-e87ec3c72a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:48.794751 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e21cc-8b68-4a64-9667-e87ec3c72a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:48.796186 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e21cc-8b68-4a64-9667-e87ec3c72a6d service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:48.805668 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 536/1078] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:51.278772 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cc08-bcf8-41ed-bb1c-ded7086ce5d7 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:51.279337 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cc08-bcf8-41ed-bb1c-ded7086ce5d7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:51.279337 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cc08-bcf8-41ed-bb1c-ded7086ce5d7 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:51.280655 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 543/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:51.285962 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62277-3037-4d8e-bf86-afef0bfd66d0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:51.286376 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62277-3037-4d8e-bf86-afef0bfd66d0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:51.286476 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62277-3037-4d8e-bf86-afef0bfd66d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:51.306230 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8db62277-3037-4d8e-bf86-afef0bfd66d0 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:51.307426 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8db62277-3037-4d8e-bf86-afef0bfd66d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:51.315207 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 537/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:51.654158 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cc08-bcf8-41ed-bb1c-ded7086ce5d7 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:51.664896 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cc08-bcf8-41ed-bb1c-ded7086ce5d7 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:51.668370 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee3749-b9b3-48c2-a64f-d4cbee7810e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:51.668964 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee3749-b9b3-48c2-a64f-d4cbee7810e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:51.669244 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee3749-b9b3-48c2-a64f-d4cbee7810e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:51.669550 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee3749-b9b3-48c2-a64f-d4cbee7810e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:51.678163 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee3749-b9b3-48c2-a64f-d4cbee7810e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:51.679593 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee3749-b9b3-48c2-a64f-d4cbee7810e8 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:51.688762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 544/1081] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:54.084380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4267c19-60b7-4a79-b984-ec667de357d4 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:54.084949 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4267c19-60b7-4a79-b984-ec667de357d4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:54.084949 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4267c19-60b7-4a79-b984-ec667de357d4 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:54.086332 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 538/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:54.091496 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1685d-8daf-49ff-b487-7081ded798ad None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:54.091931 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1685d-8daf-49ff-b487-7081ded798ad None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:54.092052 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1685d-8daf-49ff-b487-7081ded798ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:54.111177 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-74b1685d-8daf-49ff-b487-7081ded798ad None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:54.112369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-74b1685d-8daf-49ff-b487-7081ded798ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:54.120658 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 545/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:54.456051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4267c19-60b7-4a79-b984-ec667de357d4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:54.461429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=48 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:20:54.467808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4267c19-60b7-4a79-b984-ec667de357d4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:54.471261 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d58042-3121-46b6-8fe4-41b5e9b1c642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:54.471862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58042-3121-46b6-8fe4-41b5e9b1c642 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:54.472140 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58042-3121-46b6-8fe4-41b5e9b1c642 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:54.472408 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58042-3121-46b6-8fe4-41b5e9b1c642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:54.481502 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d58042-3121-46b6-8fe4-41b5e9b1c642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:54.482909 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d58042-3121-46b6-8fe4-41b5e9b1c642 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:54.491843 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 539/1084] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:20:56.971507 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bba68-3462-4d77-a99e-a6f17d618963 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:56.972070 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bba68-3462-4d77-a99e-a6f17d618963 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:56.972070 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bba68-3462-4d77-a99e-a6f17d618963 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:56.973448 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 546/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:20:56.979051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b3482-c3fa-4f3b-8487-ca17a09e1053 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:56.979472 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b3482-c3fa-4f3b-8487-ca17a09e1053 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:56.979609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b3482-c3fa-4f3b-8487-ca17a09e1053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:56.999587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d53b3482-c3fa-4f3b-8487-ca17a09e1053 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:20:57.002151 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d53b3482-c3fa-4f3b-8487-ca17a09e1053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:20:57.012170 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 540/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:20:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:20:57.348387 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bba68-3462-4d77-a99e-a6f17d618963 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:20:57.359048 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bba68-3462-4d77-a99e-a6f17d618963 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:20:57.362492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58967-3f54-4d07-83f7-f753087687c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:20:57.363085 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58967-3f54-4d07-83f7-f753087687c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:20:57.363363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58967-3f54-4d07-83f7-f753087687c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:20:57.363636 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58967-3f54-4d07-83f7-f753087687c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:20:57.372994 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae58967-3f54-4d07-83f7-f753087687c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:20:57.374475 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae58967-3f54-4d07-83f7-f753087687c4 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:20:57.384028 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 547/1087] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:20:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:06.993590 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=8 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:07.379586 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=26 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:21.849198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1492d-4a13-4b10-ad8b-66e3ac398d95 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:21.849826 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1492d-4a13-4b10-ad8b-66e3ac398d95 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:21.849826 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1492d-4a13-4b10-ad8b-66e3ac398d95 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:21.851128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 541/1088] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:21.857543 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a618-eccc-402b-833c-158bcf5e36b9 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:21.858014 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a618-eccc-402b-833c-158bcf5e36b9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:21.858167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a618-eccc-402b-833c-158bcf5e36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:21.877388 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-78c1a618-eccc-402b-833c-158bcf5e36b9 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:21.878581 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-78c1a618-eccc-402b-833c-158bcf5e36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:21.886591 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 548/1089] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:21:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:22.242564 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f700b-4bfe-4d57-9881-dccb0ef02c87 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:22.242881 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f700b-4bfe-4d57-9881-dccb0ef02c87 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:22.243154 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f700b-4bfe-4d57-9881-dccb0ef02c87 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:22.244472 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 542/1090] 10.222.0.66 () {54 vars in 966 bytes} [Wed Sep 14 15:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:22.249737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8052d-d02f-4f34-8f30-83ed305326f8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:22.250025 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8052d-d02f-4f34-8f30-83ed305326f8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:22.250299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8052d-d02f-4f34-8f30-83ed305326f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:22.270171 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ead8052d-d02f-4f34-8f30-83ed305326f8 None None] MFA Rules not processed for user `8d18577a8ba44017b686ddf1149e0244`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:22.271346 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ead8052d-d02f-4f34-8f30-83ed305326f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:22.278694 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 549/1091] 10.222.0.66 () {58 vars in 1063 bytes} [Wed Sep 14 15:21:22 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:22.286108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f700b-4bfe-4d57-9881-dccb0ef02c87 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:22.296673 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f700b-4bfe-4d57-9881-dccb0ef02c87 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:22.300191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9c1e4-b060-4e14-b609-22e7d3339404 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d18577a8ba44017b686ddf1149e0244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:22.300778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c1e4-b060-4e14-b609-22e7d3339404 service glance] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:22.301059 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c1e4-b060-4e14-b609-22e7d3339404 service glance] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:22.301349 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c1e4-b060-4e14-b609-22e7d3339404 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:22.310887 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9c1e4-b060-4e14-b609-22e7d3339404 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:22.312317 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9c1e4-b060-4e14-b609-22e7d3339404 service glance] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:22.322472 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 543/1092] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:21:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:24.800960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd05ae-5c9b-44fa-a7a5-94c0fa921571 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:24.801564 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd05ae-5c9b-44fa-a7a5-94c0fa921571 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:24.801564 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd05ae-5c9b-44fa-a7a5-94c0fa921571 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:24.802885 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 550/1093] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:24.809240 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7248d1-f0eb-4f64-96ea-ead3a5998226 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:24.809690 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7248d1-f0eb-4f64-96ea-ead3a5998226 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:24.809837 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7248d1-f0eb-4f64-96ea-ead3a5998226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:24.828545 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-cb7248d1-f0eb-4f64-96ea-ead3a5998226 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:24.829759 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cb7248d1-f0eb-4f64-96ea-ead3a5998226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:24.837951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 544/1094] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:21:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:25.163455 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd05ae-5c9b-44fa-a7a5-94c0fa921571 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:25.176364 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd05ae-5c9b-44fa-a7a5-94c0fa921571 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:25.182550 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647f705-37a9-4b3b-a236-d899cbd91dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:25.183148 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f705-37a9-4b3b-a236-d899cbd91dbf admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:25.183429 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f705-37a9-4b3b-a236-d899cbd91dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:25.183703 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f705-37a9-4b3b-a236-d899cbd91dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:25.184341 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647f705-37a9-4b3b-a236-d899cbd91dbf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:25.186182 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING py.warnings [None req-1647f705-37a9-4b3b-a236-d899cbd91dbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:21:25.186182 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: warnings.warn(msg) Sep 14 15:21:25.186182 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: Sep 14 15:21:25.187338 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647f705-37a9-4b3b-a236-d899cbd91dbf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:25.205943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 551/1095] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Sep 14 15:21:25 2022] GET /identity/v3/projects => generated 1606 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:21:27.627774 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7487740-7f30-437f-be95-eca36db1ba9e None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:27.628335 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7487740-7f30-437f-be95-eca36db1ba9e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:27.628335 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7487740-7f30-437f-be95-eca36db1ba9e None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:27.629705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 545/1096] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:27.636106 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac7eb2-544a-4779-b626-232f09a01945 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:27.636570 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac7eb2-544a-4779-b626-232f09a01945 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:27.636664 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac7eb2-544a-4779-b626-232f09a01945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:27.655677 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-81ac7eb2-544a-4779-b626-232f09a01945 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:27.656870 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-81ac7eb2-544a-4779-b626-232f09a01945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:27.665186 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 552/1097] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:21:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:28.009659 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7487740-7f30-437f-be95-eca36db1ba9e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:28.023250 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7487740-7f30-437f-be95-eca36db1ba9e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:28.028652 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53d5a7-0d3e-4566-b937-ac851409e0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:28.029246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d5a7-0d3e-4566-b937-ac851409e0c2 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:28.029716 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d5a7-0d3e-4566-b937-ac851409e0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:28.029834 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d5a7-0d3e-4566-b937-ac851409e0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:28.037822 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53d5a7-0d3e-4566-b937-ac851409e0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:28.040058 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53d5a7-0d3e-4566-b937-ac851409e0c2 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:28.049629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 546/1098] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:21:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:30.694373 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1e30-9cb6-415c-a007-e33e42e530ea None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:30.694910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1e30-9cb6-415c-a007-e33e42e530ea None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:30.694910 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1e30-9cb6-415c-a007-e33e42e530ea None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:30.696804 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 553/1099] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:30.702155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de965c-e415-485f-a12d-885765a6f3fb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:30.702580 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de965c-e415-485f-a12d-885765a6f3fb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:30.702744 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de965c-e415-485f-a12d-885765a6f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:30.722426 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f9de965c-e415-485f-a12d-885765a6f3fb None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:30.723624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f9de965c-e415-485f-a12d-885765a6f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:30.731401 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 547/1100] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:21:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:31.069377 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe1e30-9cb6-415c-a007-e33e42e530ea None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:31.080654 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe1e30-9cb6-415c-a007-e33e42e530ea None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:31.084295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7960b-6432-4b47-bdd3-2f774e0c3ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:31.084905 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7960b-6432-4b47-bdd3-2f774e0c3ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:31.085183 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7960b-6432-4b47-bdd3-2f774e0c3ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:31.085498 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7960b-6432-4b47-bdd3-2f774e0c3ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:31.094613 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7960b-6432-4b47-bdd3-2f774e0c3ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:31.096043 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7960b-6432-4b47-bdd3-2f774e0c3ad1 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:31.105460 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 554/1101] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:21:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:33.572920 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c11cb-23ce-4e5d-b924-8f1941d1af60 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:33.573495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c11cb-23ce-4e5d-b924-8f1941d1af60 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:33.573495 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c11cb-23ce-4e5d-b924-8f1941d1af60 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:33.574756 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 548/1102] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:33.579893 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d9dbe-2f35-48ee-aac6-066cd413459d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:33.580336 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d9dbe-2f35-48ee-aac6-066cd413459d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:33.580452 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d9dbe-2f35-48ee-aac6-066cd413459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:33.600798 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c81d9dbe-2f35-48ee-aac6-066cd413459d None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:33.602033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c81d9dbe-2f35-48ee-aac6-066cd413459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:33.609583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 555/1103] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:21:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:33.950810 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c11cb-23ce-4e5d-b924-8f1941d1af60 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:33.961433 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c11cb-23ce-4e5d-b924-8f1941d1af60 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:33.965120 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c71ac-385e-4726-9cd7-4b2a81323ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:33.965747 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c71ac-385e-4726-9cd7-4b2a81323ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:33.966028 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c71ac-385e-4726-9cd7-4b2a81323ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:33.966298 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c71ac-385e-4726-9cd7-4b2a81323ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:33.975113 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c71ac-385e-4726-9cd7-4b2a81323ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:33.976534 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c71ac-385e-4726-9cd7-4b2a81323ff6 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:33.985790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 549/1104] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:21:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:36.511948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c07d45-c9a6-43c8-ae0d-62fd85da7157 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:36.512526 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c07d45-c9a6-43c8-ae0d-62fd85da7157 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:36.512526 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c07d45-c9a6-43c8-ae0d-62fd85da7157 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:36.513961 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 556/1105] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:36.519140 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2da3a3-5558-4997-bfd5-6bd68febf424 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:36.519548 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2da3a3-5558-4997-bfd5-6bd68febf424 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:36.519699 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2da3a3-5558-4997-bfd5-6bd68febf424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:36.539152 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-af2da3a3-5558-4997-bfd5-6bd68febf424 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:36.540355 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-af2da3a3-5558-4997-bfd5-6bd68febf424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:36.548111 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 550/1106] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:21:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:36.893494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c07d45-c9a6-43c8-ae0d-62fd85da7157 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:36.904155 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c07d45-c9a6-43c8-ae0d-62fd85da7157 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:36.907649 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48493c7c-1de2-487a-a431-9824b72d7bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:36.908287 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48493c7c-1de2-487a-a431-9824b72d7bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:36.908563 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48493c7c-1de2-487a-a431-9824b72d7bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:36.908829 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48493c7c-1de2-487a-a431-9824b72d7bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:36.917548 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48493c7c-1de2-487a-a431-9824b72d7bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:36.918967 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48493c7c-1de2-487a-a431-9824b72d7bd6 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:36.927948 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 557/1107] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:21:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:39.499128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb2da3-0d7f-4a9d-a574-846a9be5f968 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:39.499686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb2da3-0d7f-4a9d-a574-846a9be5f968 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:39.499686 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb2da3-0d7f-4a9d-a574-846a9be5f968 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:39.501049 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 551/1108] 10.222.0.66 () {54 vars in 927 bytes} [Wed Sep 14 15:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:21:39.506525 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97113e-d7f1-48d2-b7e3-a1187a5105f7 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:39.506958 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97113e-d7f1-48d2-b7e3-a1187a5105f7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:39.507066 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97113e-d7f1-48d2-b7e3-a1187a5105f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:39.527081 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ae97113e-d7f1-48d2-b7e3-a1187a5105f7 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:21:39.528275 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ae97113e-d7f1-48d2-b7e3-a1187a5105f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:21:39.535863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 558/1109] 10.222.0.66 () {58 vars in 1024 bytes} [Wed Sep 14 15:21:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:21:39.878754 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb2da3-0d7f-4a9d-a574-846a9be5f968 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:21:39.890408 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb2da3-0d7f-4a9d-a574-846a9be5f968 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:21:39.893944 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31f892-c222-4d0a-9cb9-a176eb4fa442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:21:39.894543 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31f892-c222-4d0a-9cb9-a176eb4fa442 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:21:39.894825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31f892-c222-4d0a-9cb9-a176eb4fa442 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:21:39.895098 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31f892-c222-4d0a-9cb9-a176eb4fa442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:21:39.904078 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31f892-c222-4d0a-9cb9-a176eb4fa442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:21:39.905563 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31f892-c222-4d0a-9cb9-a176eb4fa442 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:21:39.914727 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 552/1110] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:21:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:21:49.521755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=33 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:21:49.910720 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=33 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:22:56.511184 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855dba9-dbb7-4ab3-a4a1-4a9b9cb062ed None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.511819 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855dba9-dbb7-4ab3-a4a1-4a9b9cb062ed None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.511819 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855dba9-dbb7-4ab3-a4a1-4a9b9cb062ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.531023 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2855dba9-dbb7-4ab3-a4a1-4a9b9cb062ed None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:56.532216 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2855dba9-dbb7-4ab3-a4a1-4a9b9cb062ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:56.541379 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 559/1111] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:22:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:56.549150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251eea9-2341-418d-b87c-588d60515f81 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.549722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251eea9-2341-418d-b87c-588d60515f81 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.549722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251eea9-2341-418d-b87c-588d60515f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.569472 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c251eea9-2341-418d-b87c-588d60515f81 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:56.570585 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c251eea9-2341-418d-b87c-588d60515f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:56.578394 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 553/1112] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:22:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:56.582863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855dba9-dbb7-4ab3-a4a1-4a9b9cb062ed None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:56.592441 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855dba9-dbb7-4ab3-a4a1-4a9b9cb062ed None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:56.597026 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:56.597745 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.598025 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.598296 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.598935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:22:56.599235 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:56.600748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING py.warnings [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:22:56.600748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: warnings.warn(msg) Sep 14 15:22:56.600748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: Sep 14 15:22:56.601661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:56.613090 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 560/1113] 10.222.0.66 () {58 vars in 1153 bytes} [Wed Sep 14 15:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:22:56.621848 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251eea9-2341-418d-b87c-588d60515f81 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:56.631443 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251eea9-2341-418d-b87c-588d60515f81 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:56.636372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:56.636971 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.637275 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.637581 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.638248 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:56.639990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WARNING py.warnings [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:22:56.639990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: warnings.warn(msg) Sep 14 15:22:56.639990 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: Sep 14 15:22:56.641195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:56.668767 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 554/1114] 10.222.0.66 () {60 vars in 1153 bytes} [Wed Sep 14 15:22:56 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:22:56.672877 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:56.683223 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629df5-5ca9-426a-aee1-43fa1c9685ee admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:56.737706 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:56.738321 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.738729 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.738902 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.739499 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:56.740516 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING py.warnings [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:22:56.740516 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: warnings.warn(msg) Sep 14 15:22:56.740516 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: Sep 14 15:22:56.741818 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:56.762980 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 561/1115] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:22:56 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:22:56.767176 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:56.777725 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c280da-4e4b-4ea3-920c-48fa096d6d27 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:56.782250 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:56.782840 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.783140 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.783388 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.784014 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:56.785121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WARNING py.warnings [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:22:56.785121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: warnings.warn(msg) Sep 14 15:22:56.785121 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: Sep 14 15:22:56.785972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:56.799004 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 555/1116] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:22:56.802916 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:56.812765 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2f2c6-8a91-4382-b485-fd414e42886a admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:56.817558 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d152-8569-4a43-a6ba-2003e13a159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:56.818156 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d152-8569-4a43-a6ba-2003e13a159f admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.818439 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d152-8569-4a43-a6ba-2003e13a159f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.818716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d152-8569-4a43-a6ba-2003e13a159f admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.819351 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810d152-8569-4a43-a6ba-2003e13a159f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:56.820422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING py.warnings [None req-e810d152-8569-4a43-a6ba-2003e13a159f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:22:56.820422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: warnings.warn(msg) Sep 14 15:22:56.820422 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: Sep 14 15:22:56.821249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810d152-8569-4a43-a6ba-2003e13a159f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:56.836603 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 562/1117] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:22:56.840790 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:56.851243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4ae1c-59f1-4238-b013-4b64c787ab6a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:56.855688 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e623e-c25d-4a39-a318-30ec55ea995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:56.856324 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e623e-c25d-4a39-a318-30ec55ea995b admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.856602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e623e-c25d-4a39-a318-30ec55ea995b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.856872 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e623e-c25d-4a39-a318-30ec55ea995b admin admin] PATH_INFO: `/v3/projects/f314570591f54f6590ed311388d90760/users/b86e841926a549eab613fe1ed1475cbc/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.871733 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e623e-c25d-4a39-a318-30ec55ea995b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f314570591f54f6590ed311388d90760, user_id=b86e841926a549eab613fe1ed1475cbc, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:56.872767 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WARNING py.warnings [None req-ee9e623e-c25d-4a39-a318-30ec55ea995b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:22:56.872767 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: warnings.warn(msg) Sep 14 15:22:56.872767 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: Sep 14 15:22:56.874768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e623e-c25d-4a39-a318-30ec55ea995b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:56.888628 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 556/1118] 10.222.0.66 () {60 vars in 1483 bytes} [Wed Sep 14 15:22:56 2022] PUT /identity/v3/projects/f314570591f54f6590ed311388d90760/users/b86e841926a549eab613fe1ed1475cbc/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:22:56.901199 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7908c18-0048-4aed-a58e-8c28a6a977df None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:56.901533 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7908c18-0048-4aed-a58e-8c28a6a977df None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:56.901812 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7908c18-0048-4aed-a58e-8c28a6a977df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:56.935289 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f7908c18-0048-4aed-a58e-8c28a6a977df None None] MFA Rules not processed for user `b86e841926a549eab613fe1ed1475cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:56.937058 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f7908c18-0048-4aed-a58e-8c28a6a977df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:57.008934 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 563/1119] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:22:56 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:57.023605 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb4984-f398-445e-af80-73f27ad0c80c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.023970 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb4984-f398-445e-af80-73f27ad0c80c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.024251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb4984-f398-445e-af80-73f27ad0c80c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.025741 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 557/1120] 10.222.0.66 () {54 vars in 964 bytes} [Wed Sep 14 15:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 15:22:57.031178 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45713b60-8988-4577-b9b6-3a3f555871b7 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.031511 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45713b60-8988-4577-b9b6-3a3f555871b7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.031811 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45713b60-8988-4577-b9b6-3a3f555871b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.051920 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-45713b60-8988-4577-b9b6-3a3f555871b7 None None] MFA Rules not processed for user `58b3ed4fedd54add9680e2968db68b71`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:57.053115 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-45713b60-8988-4577-b9b6-3a3f555871b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:57.095284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:22:57.104221 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 564/1121] 10.222.0.66 () {58 vars in 1061 bytes} [Wed Sep 14 15:22:57 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:57.111824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb4984-f398-445e-af80-73f27ad0c80c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:57.122155 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb4984-f398-445e-af80-73f27ad0c80c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:57.125645 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12ee64-f05c-4fbc-b228-f35787f37f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b3ed4fedd54add9680e2968db68b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:57.126230 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12ee64-f05c-4fbc-b228-f35787f37f02 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.126507 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12ee64-f05c-4fbc-b228-f35787f37f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.126779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12ee64-f05c-4fbc-b228-f35787f37f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.135404 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12ee64-f05c-4fbc-b228-f35787f37f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:57.136805 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12ee64-f05c-4fbc-b228-f35787f37f02 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:57.145340 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 558/1122] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:22:57 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:22:57.183554 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141d513-20ea-4a05-b5a3-452e2aa0b61e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.183847 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141d513-20ea-4a05-b5a3-452e2aa0b61e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.184128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141d513-20ea-4a05-b5a3-452e2aa0b61e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.185445 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 565/1123] 10.222.0.66 () {52 vars in 830 bytes} [Wed Sep 14 15:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:22:57.188903 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12ee64-f05c-4fbc-b228-f35787f37f02 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:57.254402 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12ee64-f05c-4fbc-b228-f35787f37f02 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:57.259751 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:57.260381 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.260667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.260949 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] PATH_INFO: `/v3/users/b86e841926a549eab613fe1ed1475cbc` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.262124 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86e841926a549eab613fe1ed1475cbc)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:57.263135 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WARNING py.warnings [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:22:57.263135 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: warnings.warn(msg) Sep 14 15:22:57.263135 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: Sep 14 15:22:57.264357 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:57.336951 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86e841926a549eab613fe1ed1475cbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:57.337619 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86e841926a549eab613fe1ed1475cbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:57.346212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86e841926a549eab613fe1ed1475cbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:57.360046 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86e841926a549eab613fe1ed1475cbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:57.360776 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86e841926a549eab613fe1ed1475cbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:57.388528 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 559/1124] 10.222.0.66 () {58 vars in 1224 bytes} [Wed Sep 14 15:22:57 2022] DELETE /identity/v3/users/b86e841926a549eab613fe1ed1475cbc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:22:57.392903 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9849a-bf50-40f3-b367-79d1fd1bac52 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.393188 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9849a-bf50-40f3-b367-79d1fd1bac52 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.393489 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9849a-bf50-40f3-b367-79d1fd1bac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.412838 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-15a9849a-bf50-40f3-b367-79d1fd1bac52 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:22:57.414057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-15a9849a-bf50-40f3-b367-79d1fd1bac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:57.472581 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 566/1125] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:22:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:22:57.482972 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:57.484382 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:57.489813 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:22:57.543051 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246e05a-c40d-443f-bbbf-f6e5d50b2098 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:57.546699 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90eaa6-a656-4161-af97-4f973a5001ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:57.547304 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90eaa6-a656-4161-af97-4f973a5001ad service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.547587 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90eaa6-a656-4161-af97-4f973a5001ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.547867 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90eaa6-a656-4161-af97-4f973a5001ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.557246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90eaa6-a656-4161-af97-4f973a5001ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:57.558702 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90eaa6-a656-4161-af97-4f973a5001ad service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:57.567950 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 560/1126] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:22:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:22:57.948169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9849a-bf50-40f3-b367-79d1fd1bac52 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:22:57.949965 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-15a9849a-bf50-40f3-b367-79d1fd1bac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:22:57.963719 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9849a-bf50-40f3-b367-79d1fd1bac52 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:22:57.968642 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:22:57.969418 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:22:57.969772 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:22:57.970167 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] PATH_INFO: `/v3/projects/f314570591f54f6590ed311388d90760` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:22:57.971612 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f314570591f54f6590ed311388d90760)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:22:57.972701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING py.warnings [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:22:57.972701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: warnings.warn(msg) Sep 14 15:22:57.972701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: Sep 14 15:22:57.974023 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:22:58.037031 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f314570591f54f6590ed311388d90760', 'request_id': 'req-6fd103f6-602c-44f6-9e0b-6384be9fe432'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:58.043246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f314570591f54f6590ed311388d90760', 'request_id': 'req-6fd103f6-602c-44f6-9e0b-6384be9fe432'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:58.056735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f314570591f54f6590ed311388d90760', 'request_id': 'req-6fd103f6-602c-44f6-9e0b-6384be9fe432'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:58.072259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] The token cache is being invalidate because project f314570591f54f6590ed311388d90760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:22:58.072561 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:58.073299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6fd103f6-602c-44f6-9e0b-6384be9fe432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:22:58.074901 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 567/1127] 10.222.0.66 () {58 vars in 1233 bytes} [Wed Sep 14 15:22:57 2022] DELETE /identity/v3/projects/f314570591f54f6590ed311388d90760 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:23:07.563925 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=25 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:23:08.068299 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:22.220266 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a852-5a20-46a3-a8c8-2a192ed3bf42 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:22.220862 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a852-5a20-46a3-a8c8-2a192ed3bf42 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:22.221002 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a852-5a20-46a3-a8c8-2a192ed3bf42 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:22.222487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 561/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:22.227399 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35cf2-35d1-4645-8288-ce3147f7cb04 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:22.227844 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35cf2-35d1-4645-8288-ce3147f7cb04 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:22.227942 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c35cf2-35d1-4645-8288-ce3147f7cb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:22.298396 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-02c35cf2-35d1-4645-8288-ce3147f7cb04 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:22.299609 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-02c35cf2-35d1-4645-8288-ce3147f7cb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:22.391400 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 568/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:24:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:22.549291 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9a852-5a20-46a3-a8c8-2a192ed3bf42 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:22.551007 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-73c9a852-5a20-46a3-a8c8-2a192ed3bf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:22.638533 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9a852-5a20-46a3-a8c8-2a192ed3bf42 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:22.643704 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf833f2-1d85-48dd-9abf-a1b5bba30da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:22.644339 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf833f2-1d85-48dd-9abf-a1b5bba30da3 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:22.644623 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf833f2-1d85-48dd-9abf-a1b5bba30da3 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:22.644905 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf833f2-1d85-48dd-9abf-a1b5bba30da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:22.652984 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf833f2-1d85-48dd-9abf-a1b5bba30da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:22.654641 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf833f2-1d85-48dd-9abf-a1b5bba30da3 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:22.663909 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 562/1130] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:24.291311 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521721a-9f23-4975-9a99-5f4a5ef46441 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:24.291836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521721a-9f23-4975-9a99-5f4a5ef46441 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:24.291836 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521721a-9f23-4975-9a99-5f4a5ef46441 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:24.293118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 569/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:24.302203 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1f16-bd8e-4645-9145-baf19caa6ea9 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:24.302639 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1f16-bd8e-4645-9145-baf19caa6ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:24.302746 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1f16-bd8e-4645-9145-baf19caa6ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:24.323833 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-29fd1f16-bd8e-4645-9145-baf19caa6ea9 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:24.325027 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-29fd1f16-bd8e-4645-9145-baf19caa6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:24.333050 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 563/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:24:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:24.491818 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521721a-9f23-4975-9a99-5f4a5ef46441 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:24.505183 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521721a-9f23-4975-9a99-5f4a5ef46441 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:24.510360 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4eeb1-7c1f-4c14-a046-511e9568d254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:24.510952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4eeb1-7c1f-4c14-a046-511e9568d254 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:24.511237 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4eeb1-7c1f-4c14-a046-511e9568d254 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:24.511509 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4eeb1-7c1f-4c14-a046-511e9568d254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:24.519563 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4eeb1-7c1f-4c14-a046-511e9568d254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:24.521147 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4eeb1-7c1f-4c14-a046-511e9568d254 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:24.530960 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 570/1133] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:27.195034 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc951-35f3-4caf-9be2-c3b14646acc6 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:27.195529 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc951-35f3-4caf-9be2-c3b14646acc6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:27.195646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc951-35f3-4caf-9be2-c3b14646acc6 None None] PATH_INFO: `/v3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:27.196873 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 564/1134] 10.222.0.49 () {54 vars in 925 bytes} [Wed Sep 14 15:24:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 15:24:27.202842 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f1830-432a-400a-91cc-cdda6c38f168 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:27.203254 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f1830-432a-400a-91cc-cdda6c38f168 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:27.203398 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f1830-432a-400a-91cc-cdda6c38f168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:27.232923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a59f1830-432a-400a-91cc-cdda6c38f168 None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:27.234144 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a59f1830-432a-400a-91cc-cdda6c38f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:27.288315 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:27.298480 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 571/1135] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Sep 14 15:24:27 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:24:34.318812 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=42 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:24:36.057138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c502-73ad-4b81-83a6-099c2833ca48 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:36.057709 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c502-73ad-4b81-83a6-099c2833ca48 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:36.058006 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c502-73ad-4b81-83a6-099c2833ca48 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:36.059465 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 565/1136] 10.222.0.66 () {54 vars in 961 bytes} [Wed Sep 14 15:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:36.065781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eefec-e9d2-410a-818e-05bd682fd89a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:36.066249 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eefec-e9d2-410a-818e-05bd682fd89a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:36.066349 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eefec-e9d2-410a-818e-05bd682fd89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:36.085668 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-644eefec-e9d2-410a-818e-05bd682fd89a None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:36.087065 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-644eefec-e9d2-410a-818e-05bd682fd89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:36.095876 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 572/1137] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Sep 14 15:24:36 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:36.103188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3c502-73ad-4b81-83a6-099c2833ca48 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:36.117440 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3c502-73ad-4b81-83a6-099c2833ca48 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:36.123071 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bff60c-85c9-4141-b3ea-ed5d5ea375eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d0e3301ff94f37a05bfd75397956d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:36.123672 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff60c-85c9-4141-b3ea-ed5d5ea375eb service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:36.123952 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff60c-85c9-4141-b3ea-ed5d5ea375eb service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:36.124225 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff60c-85c9-4141-b3ea-ed5d5ea375eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:36.132569 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bff60c-85c9-4141-b3ea-ed5d5ea375eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:36.134424 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bff60c-85c9-4141-b3ea-ed5d5ea375eb service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:36.143969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 566/1138] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:36 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:36.625056 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02ce22-f299-4edc-a6c6-b7a0c54b2891 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:36.625373 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02ce22-f299-4edc-a6c6-b7a0c54b2891 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:36.625658 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02ce22-f299-4edc-a6c6-b7a0c54b2891 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:36.627002 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 573/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:36.631927 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9c4e4-a6d9-4854-890a-af99860b3a52 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:36.632247 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9c4e4-a6d9-4854-890a-af99860b3a52 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:36.632620 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9c4e4-a6d9-4854-890a-af99860b3a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:36.653981 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-58b9c4e4-a6d9-4854-890a-af99860b3a52 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:36.655209 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-58b9c4e4-a6d9-4854-890a-af99860b3a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:36.663425 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 567/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:24:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:36.834270 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02ce22-f299-4edc-a6c6-b7a0c54b2891 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:36.847604 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02ce22-f299-4edc-a6c6-b7a0c54b2891 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:36.852328 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4753851-d80f-4456-8b1d-2769d221b18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:36.852919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753851-d80f-4456-8b1d-2769d221b18f service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:36.853709 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753851-d80f-4456-8b1d-2769d221b18f service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:36.854008 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753851-d80f-4456-8b1d-2769d221b18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:36.862097 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753851-d80f-4456-8b1d-2769d221b18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:36.863684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753851-d80f-4456-8b1d-2769d221b18f service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:36.873513 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 574/1141] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:38.479605 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bdb5d-6533-489b-aa44-14408f8fab4a None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.480245 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bdb5d-6533-489b-aa44-14408f8fab4a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.480245 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bdb5d-6533-489b-aa44-14408f8fab4a None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.481507 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 568/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:38.486191 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bed10-68a1-46cd-be37-c377240908bb None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.486605 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bed10-68a1-46cd-be37-c377240908bb None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.486748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bed10-68a1-46cd-be37-c377240908bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.506316 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0d6bed10-68a1-46cd-be37-c377240908bb None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:38.507527 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0d6bed10-68a1-46cd-be37-c377240908bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:38.515512 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 575/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 15:24:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:38.675343 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bdb5d-6533-489b-aa44-14408f8fab4a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:38.688358 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bdb5d-6533-489b-aa44-14408f8fab4a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:38.693200 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e07148-18f6-4f58-82c0-3c5ea9eda354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:38.693808 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e07148-18f6-4f58-82c0-3c5ea9eda354 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:38.694085 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e07148-18f6-4f58-82c0-3c5ea9eda354 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:38.694353 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e07148-18f6-4f58-82c0-3c5ea9eda354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:38.702148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e07148-18f6-4f58-82c0-3c5ea9eda354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:38.703699 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e07148-18f6-4f58-82c0-3c5ea9eda354 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:38.713341 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 569/1144] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:43.220682 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff2050-e61c-41e0-a69b-9be6f484c6d0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:43.221564 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff2050-e61c-41e0-a69b-9be6f484c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:43.221564 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff2050-e61c-41e0-a69b-9be6f484c6d0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:43.222594 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 576/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:43.227751 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13855e-1118-47b8-8bcf-9f90e4e2e7fd None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:43.228744 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13855e-1118-47b8-8bcf-9f90e4e2e7fd None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:43.228954 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13855e-1118-47b8-8bcf-9f90e4e2e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:43.249807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ad13855e-1118-47b8-8bcf-9f90e4e2e7fd None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:43.251000 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ad13855e-1118-47b8-8bcf-9f90e4e2e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:43.258930 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 570/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:24:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:43.610179 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff2050-e61c-41e0-a69b-9be6f484c6d0 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:43.611883 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3eff2050-e61c-41e0-a69b-9be6f484c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:43.669742 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff2050-e61c-41e0-a69b-9be6f484c6d0 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:43.673305 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2124ab2-d834-433b-9239-33ccb746a0fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:43.673935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2124ab2-d834-433b-9239-33ccb746a0fc service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:43.674216 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2124ab2-d834-433b-9239-33ccb746a0fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:43.674492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2124ab2-d834-433b-9239-33ccb746a0fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:43.683338 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2124ab2-d834-433b-9239-33ccb746a0fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:43.684774 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2124ab2-d834-433b-9239-33ccb746a0fc service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:43.694137 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 577/1147] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:46.059840 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1ac8-edde-4b37-bb2b-6e16e841af21 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:46.060421 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1ac8-edde-4b37-bb2b-6e16e841af21 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:46.060421 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1ac8-edde-4b37-bb2b-6e16e841af21 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:46.061788 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 571/1148] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:46.067114 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6513-4f2b-4f07-9355-50ed9ca78a38 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:46.067530 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6513-4f2b-4f07-9355-50ed9ca78a38 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:46.067670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6513-4f2b-4f07-9355-50ed9ca78a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:46.086973 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-d58e6513-4f2b-4f07-9355-50ed9ca78a38 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:46.088172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d58e6513-4f2b-4f07-9355-50ed9ca78a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:46.095919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 578/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:24:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:46.434715 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1ac8-edde-4b37-bb2b-6e16e841af21 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:46.445487 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1ac8-edde-4b37-bb2b-6e16e841af21 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:46.449102 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe84da-956e-481f-b9f3-a66bbfe787d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:46.449724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe84da-956e-481f-b9f3-a66bbfe787d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:46.450035 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe84da-956e-481f-b9f3-a66bbfe787d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:46.450310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe84da-956e-481f-b9f3-a66bbfe787d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:46.459624 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe84da-956e-481f-b9f3-a66bbfe787d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:46.461126 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe84da-956e-481f-b9f3-a66bbfe787d1 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:46.471157 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 572/1150] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:50.381744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238cc2-ea74-4966-bf6a-75a6f8e3b76b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:50.382300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238cc2-ea74-4966-bf6a-75a6f8e3b76b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:50.382300 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238cc2-ea74-4966-bf6a-75a6f8e3b76b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:50.383892 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 579/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:50.389596 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9b9e-9af5-4383-a9b4-6b4f315bda6e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:50.390046 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9b9e-9af5-4383-a9b4-6b4f315bda6e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:50.390186 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9b9e-9af5-4383-a9b4-6b4f315bda6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:50.409998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-083e9b9e-9af5-4383-a9b4-6b4f315bda6e None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:50.411196 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-083e9b9e-9af5-4383-a9b4-6b4f315bda6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:50.418966 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 573/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:24:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:50.773157 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52238cc2-ea74-4966-bf6a-75a6f8e3b76b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:50.774853 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-52238cc2-ea74-4966-bf6a-75a6f8e3b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:50.832205 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52238cc2-ea74-4966-bf6a-75a6f8e3b76b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:50.835710 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccacd2-e062-4901-a838-d288c01fb867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b3ed4fedd54add9680e2968db68b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:50.836313 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccacd2-e062-4901-a838-d288c01fb867 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:50.836592 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccacd2-e062-4901-a838-d288c01fb867 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:50.836866 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccacd2-e062-4901-a838-d288c01fb867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:50.845737 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccacd2-e062-4901-a838-d288c01fb867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:50.847157 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccacd2-e062-4901-a838-d288c01fb867 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:50.856293 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 580/1153] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:24:53.215242 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66322ed6-5a52-40ed-a5d8-512a6216cc06 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:53.215768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66322ed6-5a52-40ed-a5d8-512a6216cc06 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:53.215768 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66322ed6-5a52-40ed-a5d8-512a6216cc06 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:53.217117 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 574/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 15:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:24:53.222291 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934002a-0556-43cc-ad3f-76cfe21804df None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:53.222716 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934002a-0556-43cc-ad3f-76cfe21804df None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:53.222856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934002a-0556-43cc-ad3f-76cfe21804df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:53.242639 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a934002a-0556-43cc-ad3f-76cfe21804df None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:24:53.243837 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a934002a-0556-43cc-ad3f-76cfe21804df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:53.252295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 581/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 15:24:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:24:53.602541 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66322ed6-5a52-40ed-a5d8-512a6216cc06 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:24:53.604408 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-66322ed6-5a52-40ed-a5d8-512a6216cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:24:53.630048 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66322ed6-5a52-40ed-a5d8-512a6216cc06 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:24:53.633868 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cb83f-3b01-4fc4-b225-773881680dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b3ed4fedd54add9680e2968db68b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:24:53.634469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cb83f-3b01-4fc4-b225-773881680dcc service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:24:53.635390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cb83f-3b01-4fc4-b225-773881680dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:24:53.635667 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cb83f-3b01-4fc4-b225-773881680dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:24:53.644467 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cb83f-3b01-4fc4-b225-773881680dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:24:53.645926 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cb83f-3b01-4fc4-b225-773881680dcc service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:24:53.655166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 575/1156] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:24:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:25:03.237761 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=70 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:25:03.651081 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=38 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:07.866402 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a9f7-ad3b-487b-8fd4-71737c525da0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:07.867050 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a9f7-ad3b-487b-8fd4-71737c525da0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:07.867050 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a9f7-ad3b-487b-8fd4-71737c525da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:07.887972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0ac1a9f7-ad3b-487b-8fd4-71737c525da0 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:07.889169 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0ac1a9f7-ad3b-487b-8fd4-71737c525da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:07.897972 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 582/1157] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:07.906511 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da887-360d-4401-8333-5e4ae39a1c74 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:07.907097 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da887-360d-4401-8333-5e4ae39a1c74 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:07.907201 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da887-360d-4401-8333-5e4ae39a1c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:07.928604 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c36da887-360d-4401-8333-5e4ae39a1c74 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:07.929940 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c36da887-360d-4401-8333-5e4ae39a1c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:07.938313 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 576/1158] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:07.943164 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da887-360d-4401-8333-5e4ae39a1c74 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:07.943315 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaeb9e-3822-4bc2-acd5-24482bd23d69 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:07.943567 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaeb9e-3822-4bc2-acd5-24482bd23d69 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:07.943848 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaeb9e-3822-4bc2-acd5-24482bd23d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:07.952964 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da887-360d-4401-8333-5e4ae39a1c74 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:07.957611 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:07.958212 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:07.958492 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:07.958763 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:07.959405 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:26:07.959706 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:07.960722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WARNING py.warnings [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:26:07.960722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: warnings.warn(msg) Sep 14 15:26:07.960722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: Sep 14 15:26:07.961626 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:07.965250 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-1ebaeb9e-3822-4bc2-acd5-24482bd23d69 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:07.966483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1ebaeb9e-3822-4bc2-acd5-24482bd23d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:07.980703 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 577/1159] 10.222.0.66 () {58 vars in 1153 bytes} [Wed Sep 14 15:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:26:07.980923 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 583/1160] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:07.982090 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:07.982535 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3388af-6aba-4d6c-9d4b-41194785f515 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:07.982821 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3388af-6aba-4d6c-9d4b-41194785f515 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:07.983118 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3388af-6aba-4d6c-9d4b-41194785f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:07.991983 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f052c-774e-43d0-b2e5-1770a31d667e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:07.997709 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428db11-e2f4-4609-92d6-b5d23c3198b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:07.998333 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428db11-e2f4-4609-92d6-b5d23c3198b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:07.998611 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428db11-e2f4-4609-92d6-b5d23c3198b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:07.998881 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428db11-e2f4-4609-92d6-b5d23c3198b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:07.999539 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428db11-e2f4-4609-92d6-b5d23c3198b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.001459 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428db11-e2f4-4609-92d6-b5d23c3198b6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.005896 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0f3388af-6aba-4d6c-9d4b-41194785f515 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:08.005896 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0f3388af-6aba-4d6c-9d4b-41194785f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:08.017022 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 584/1161] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:08.020415 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3388af-6aba-4d6c-9d4b-41194785f515 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.032935 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3388af-6aba-4d6c-9d4b-41194785f515 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.038906 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.039742 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.040036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.040452 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.041115 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 15:26:08.041745 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.043081 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.051279 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 578/1162] 10.222.0.66 () {60 vars in 1153 bytes} [Wed Sep 14 15:26:07 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:26:08.052327 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428db11-e2f4-4609-92d6-b5d23c3198b6 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.061104 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 585/1163] 10.222.0.66 () {58 vars in 1153 bytes} [Wed Sep 14 15:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 15:26:08.065653 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.077352 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104c860-ef68-4ae3-864a-6d492a917429 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.125386 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428db11-e2f4-4609-92d6-b5d23c3198b6 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.131937 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.132566 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.132930 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.133272 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.133946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.135806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WARNING py.warnings [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:26:08.135806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: warnings.warn(msg) Sep 14 15:26:08.135806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: Sep 14 15:26:08.137036 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.141994 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.142605 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.142938 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.143210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.143850 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.144859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING py.warnings [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:26:08.144859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: warnings.warn(msg) Sep 14 15:26:08.144859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: Sep 14 15:26:08.146089 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.166197 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 579/1164] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:26:08 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:26:08.170824 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.185647 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 586/1165] 10.222.0.66 () {60 vars in 1153 bytes} [Wed Sep 14 15:26:08 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:26:08.186198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335005-c9af-4ab2-8bbd-08740dc39494 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.190661 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.271778 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dca145-c0b1-43fa-bcf7-1212a594e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.272403 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca145-c0b1-43fa-bcf7-1212a594e284 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.272692 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca145-c0b1-43fa-bcf7-1212a594e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.272969 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dca145-c0b1-43fa-bcf7-1212a594e284 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.273687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dca145-c0b1-43fa-bcf7-1212a594e284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.275426 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dca145-c0b1-43fa-bcf7-1212a594e284 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.275713 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7989ea-2dd4-4f54-9f50-d1b02d8214f3 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.283111 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e745e8f-1397-458d-94cb-719c42557d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.284054 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e745e8f-1397-458d-94cb-719c42557d92 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.284528 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e745e8f-1397-458d-94cb-719c42557d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.284916 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e745e8f-1397-458d-94cb-719c42557d92 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.286001 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e745e8f-1397-458d-94cb-719c42557d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.286660 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 580/1166] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:26:08.289015 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e745e8f-1397-458d-94cb-719c42557d92 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.292870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dca145-c0b1-43fa-bcf7-1212a594e284 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.302696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dca145-c0b1-43fa-bcf7-1212a594e284 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.310482 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea536c1-0ded-4a17-a948-c5e57cd65667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.311310 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea536c1-0ded-4a17-a948-c5e57cd65667 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.311598 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea536c1-0ded-4a17-a948-c5e57cd65667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.311874 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea536c1-0ded-4a17-a948-c5e57cd65667 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.312935 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea536c1-0ded-4a17-a948-c5e57cd65667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.315018 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea536c1-0ded-4a17-a948-c5e57cd65667 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.320172 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 587/1167] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:26:08 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:26:08.324132 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e745e8f-1397-458d-94cb-719c42557d92 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.330644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 581/1168] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:26:08.331943 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea536c1-0ded-4a17-a948-c5e57cd65667 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.336035 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e745e8f-1397-458d-94cb-719c42557d92 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.341207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedaa05-149b-4548-9571-e39424572dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.341876 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedaa05-149b-4548-9571-e39424572dae admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.342278 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedaa05-149b-4548-9571-e39424572dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.342500 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedaa05-149b-4548-9571-e39424572dae admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.343241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedaa05-149b-4548-9571-e39424572dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.343517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea536c1-0ded-4a17-a948-c5e57cd65667 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.344942 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedaa05-149b-4548-9571-e39424572dae admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.349355 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07b5bf-d64c-4c92-80b5-ae5c58e17408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.350224 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07b5bf-d64c-4c92-80b5-ae5c58e17408 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.350387 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07b5bf-d64c-4c92-80b5-ae5c58e17408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.350666 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07b5bf-d64c-4c92-80b5-ae5c58e17408 admin admin] PATH_INFO: `/v3/projects/eab144fde5684204b6c33461618a76d2/users/0b18ca4bf0b34ca68ba6a54963584c50/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.356776 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 588/1169] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:26:08.362632 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedaa05-149b-4548-9571-e39424572dae admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.371000 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07b5bf-d64c-4c92-80b5-ae5c58e17408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab144fde5684204b6c33461618a76d2, user_id=0b18ca4bf0b34ca68ba6a54963584c50, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.373679 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07b5bf-d64c-4c92-80b5-ae5c58e17408 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.373831 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedaa05-149b-4548-9571-e39424572dae admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.379320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16924210-4fc0-4ab7-95e5-a1288f7916d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.380100 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16924210-4fc0-4ab7-95e5-a1288f7916d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.380391 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16924210-4fc0-4ab7-95e5-a1288f7916d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.380669 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16924210-4fc0-4ab7-95e5-a1288f7916d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.381335 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16924210-4fc0-4ab7-95e5-a1288f7916d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.383037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16924210-4fc0-4ab7-95e5-a1288f7916d4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.383456 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:08.391898 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 582/1170] 10.222.0.66 () {60 vars in 1483 bytes} [Wed Sep 14 15:26:08 2022] PUT /identity/v3/projects/eab144fde5684204b6c33461618a76d2/users/0b18ca4bf0b34ca68ba6a54963584c50/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:26:08.398504 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 589/1171] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 15:26:08.399952 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16924210-4fc0-4ab7-95e5-a1288f7916d4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.400845 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf100c39-8e80-47e8-8978-6af134231bcc None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.401142 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf100c39-8e80-47e8-8978-6af134231bcc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.401476 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf100c39-8e80-47e8-8978-6af134231bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.410033 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16924210-4fc0-4ab7-95e5-a1288f7916d4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.424379 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-bf100c39-8e80-47e8-8978-6af134231bcc None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:08.425627 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bf100c39-8e80-47e8-8978-6af134231bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:08.428275 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:08.476710 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bdc7-80da-48b9-a984-be049d9cd98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.477459 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bdc7-80da-48b9-a984-be049d9cd98f admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.477744 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bdc7-80da-48b9-a984-be049d9cd98f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.478057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bdc7-80da-48b9-a984-be049d9cd98f admin admin] PATH_INFO: `/v3/projects/4bf4b080069347b4b560ff59edcfd87e/users/5cf293fe9a254a189f52f9cf7eeef125/roles/640205c745f84440b40441060cf8c9b4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.492990 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59bdc7-80da-48b9-a984-be049d9cd98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf4b080069347b4b560ff59edcfd87e, user_id=5cf293fe9a254a189f52f9cf7eeef125, role_id=640205c745f84440b40441060cf8c9b4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.493828 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 583/1172] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:08.497740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING py.warnings [None req-2c59bdc7-80da-48b9-a984-be049d9cd98f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:26:08.497740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: warnings.warn(msg) Sep 14 15:26:08.497740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: Sep 14 15:26:08.499742 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59bdc7-80da-48b9-a984-be049d9cd98f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.505722 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf100c39-8e80-47e8-8978-6af134231bcc None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.514913 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 590/1173] 10.222.0.66 () {60 vars in 1483 bytes} [Wed Sep 14 15:26:08 2022] PUT /identity/v3/projects/4bf4b080069347b4b560ff59edcfd87e/users/5cf293fe9a254a189f52f9cf7eeef125/roles/640205c745f84440b40441060cf8c9b4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:26:08.519931 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10177-7358-427b-81c8-75cc44817807 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.520246 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10177-7358-427b-81c8-75cc44817807 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.520523 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10177-7358-427b-81c8-75cc44817807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.539974 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a0f10177-7358-427b-81c8-75cc44817807 None None] MFA Rules not processed for user `076e0863cb5c4974ba2d2e1b515b38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:08.541675 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a0f10177-7358-427b-81c8-75cc44817807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:08.565475 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf100c39-8e80-47e8-8978-6af134231bcc None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.607493 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 591/1174] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:26:08.616708 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec08fc-4288-4909-9784-f9b6896aaa32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.617417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec08fc-4288-4909-9784-f9b6896aaa32 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.617696 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec08fc-4288-4909-9784-f9b6896aaa32 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.617967 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec08fc-4288-4909-9784-f9b6896aaa32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.618368 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f10177-7358-427b-81c8-75cc44817807 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:08.628320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f10177-7358-427b-81c8-75cc44817807 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:08.628481 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec08fc-4288-4909-9784-f9b6896aaa32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.629967 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec08fc-4288-4909-9784-f9b6896aaa32 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.632123 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba4934-9114-47ad-bab4-6d5d32fd8387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:08.632720 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba4934-9114-47ad-bab4-6d5d32fd8387 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:08.632997 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba4934-9114-47ad-bab4-6d5d32fd8387 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:08.633268 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba4934-9114-47ad-bab4-6d5d32fd8387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:08.640390 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 584/1175] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:26:08.644161 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba4934-9114-47ad-bab4-6d5d32fd8387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:08.645748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba4934-9114-47ad-bab4-6d5d32fd8387 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:08.655359 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 592/1176] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:26:15.156150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e0db-56a3-40d3-a473-77fb2afb78ed None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.157166 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e0db-56a3-40d3-a473-77fb2afb78ed None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.157668 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e0db-56a3-40d3-a473-77fb2afb78ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.190921 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ce98e0db-56a3-40d3-a473-77fb2afb78ed None None] MFA Rules not processed for user `0b18ca4bf0b34ca68ba6a54963584c50`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:15.192672 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ce98e0db-56a3-40d3-a473-77fb2afb78ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:15.218128 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e530-7e05-4e20-9702-003be983a40e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.225797 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e530-7e05-4e20-9702-003be983a40e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.225962 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e530-7e05-4e20-9702-003be983a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.266489 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:15.310320 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ce77e530-7e05-4e20-9702-003be983a40e None None] MFA Rules not processed for user `5cf293fe9a254a189f52f9cf7eeef125`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:15.314130 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ce77e530-7e05-4e20-9702-003be983a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:15.326732 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 585/1177] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:15 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:15.327745 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e0db-56a3-40d3-a473-77fb2afb78ed None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.340644 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e0db-56a3-40d3-a473-77fb2afb78ed None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.350846 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c89a6c-77db-4d8a-ae3f-4e908dce6167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.351484 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c89a6c-77db-4d8a-ae3f-4e908dce6167 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.351916 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c89a6c-77db-4d8a-ae3f-4e908dce6167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.352195 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c89a6c-77db-4d8a-ae3f-4e908dce6167 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.352837 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c89a6c-77db-4d8a-ae3f-4e908dce6167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.356018 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c89a6c-77db-4d8a-ae3f-4e908dce6167 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.413614 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 586/1178] 10.222.0.66 () {60 vars in 1153 bytes} [Wed Sep 14 15:26:15 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:26:15.417128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c89a6c-77db-4d8a-ae3f-4e908dce6167 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.467163 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 593/1179] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:15 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:15.471092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77e530-7e05-4e20-9702-003be983a40e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.487886 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77e530-7e05-4e20-9702-003be983a40e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.518830 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c89a6c-77db-4d8a-ae3f-4e908dce6167 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.523860 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:15.527258 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3414-c063-4f23-bb45-53278ecfe5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.530588 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3414-c063-4f23-bb45-53278ecfe5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.532025 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3414-c063-4f23-bb45-53278ecfe5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.532960 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3414-c063-4f23-bb45-53278ecfe5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.535219 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3414-c063-4f23-bb45-53278ecfe5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.537177 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3414-c063-4f23-bb45-53278ecfe5b7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.585074 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 587/1180] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:26:15 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 15:26:15.589622 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3414-c063-4f23-bb45-53278ecfe5b7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.603041 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3414-c063-4f23-bb45-53278ecfe5b7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.610520 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c75ff-a2e3-487f-9754-1bca93f29760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.611604 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c75ff-a2e3-487f-9754-1bca93f29760 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.612054 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c75ff-a2e3-487f-9754-1bca93f29760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.612498 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c75ff-a2e3-487f-9754-1bca93f29760 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.613031 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a10c4-47c1-421d-8a62-996ef13bef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.613631 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c75ff-a2e3-487f-9754-1bca93f29760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.614192 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a10c4-47c1-421d-8a62-996ef13bef91 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.614546 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a10c4-47c1-421d-8a62-996ef13bef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.614900 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a10c4-47c1-421d-8a62-996ef13bef91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.615610 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a10c4-47c1-421d-8a62-996ef13bef91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.616564 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c75ff-a2e3-487f-9754-1bca93f29760 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.617986 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a10c4-47c1-421d-8a62-996ef13bef91 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.629680 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 588/1181] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:26:15.637998 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c75ff-a2e3-487f-9754-1bca93f29760 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.653038 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c75ff-a2e3-487f-9754-1bca93f29760 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.660220 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e646f9-96eb-45bb-9672-60faafb9754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.661386 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 594/1182] 10.222.0.66 () {60 vars in 1153 bytes} [Wed Sep 14 15:26:15 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:26:15.665456 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e646f9-96eb-45bb-9672-60faafb9754a admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.666336 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e646f9-96eb-45bb-9672-60faafb9754a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.666629 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e646f9-96eb-45bb-9672-60faafb9754a admin admin] PATH_INFO: `/v3/projects/383277b10f8c4cbb8263b24a222a9112/users/c6c39af4aae14370a653f0d916af065c/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.667505 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a10c4-47c1-421d-8a62-996ef13bef91 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.684860 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e646f9-96eb-45bb-9672-60faafb9754a admin admin] RBAC: Authorizing `identity:create_grant(project_id=383277b10f8c4cbb8263b24a222a9112, user_id=c6c39af4aae14370a653f0d916af065c, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.689807 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e646f9-96eb-45bb-9672-60faafb9754a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.719695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 589/1183] 10.222.0.66 () {60 vars in 1483 bytes} [Wed Sep 14 15:26:15 2022] PUT /identity/v3/projects/383277b10f8c4cbb8263b24a222a9112/users/c6c39af4aae14370a653f0d916af065c/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:26:15.732171 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e646f9-96eb-45bb-9672-60faafb9754a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.765839 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a10c4-47c1-421d-8a62-996ef13bef91 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.833617 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e646f9-96eb-45bb-9672-60faafb9754a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.840282 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f38214-765b-48f0-891b-7f1b5fecf488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.841307 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38214-765b-48f0-891b-7f1b5fecf488 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.841718 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38214-765b-48f0-891b-7f1b5fecf488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.842114 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38214-765b-48f0-891b-7f1b5fecf488 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.842947 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f38214-765b-48f0-891b-7f1b5fecf488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.845078 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f38214-765b-48f0-891b-7f1b5fecf488 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.857937 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe9fb8-86d7-49e8-aa64-149409517ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.859907 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 590/1184] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:26:15.861519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9fb8-86d7-49e8-aa64-149409517ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.861975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9fb8-86d7-49e8-aa64-149409517ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.862262 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9fb8-86d7-49e8-aa64-149409517ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.863121 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe9fb8-86d7-49e8-aa64-149409517ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.865409 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe9fb8-86d7-49e8-aa64-149409517ca9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.866462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f38214-765b-48f0-891b-7f1b5fecf488 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.893994 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 595/1185] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Sep 14 15:26:15 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 15:26:15.897583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe9fb8-86d7-49e8-aa64-149409517ca9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.897839 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f38214-765b-48f0-891b-7f1b5fecf488 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.905850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039148cb-ac8a-448d-982e-a63ab355c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.907322 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148cb-ac8a-448d-982e-a63ab355c84a admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.908207 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148cb-ac8a-448d-982e-a63ab355c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.908706 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148cb-ac8a-448d-982e-a63ab355c84a admin admin] PATH_INFO: `/v3/projects/383277b10f8c4cbb8263b24a222a9112/users/c6c39af4aae14370a653f0d916af065c/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.908827 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe9fb8-86d7-49e8-aa64-149409517ca9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:15.912505 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039148cb-ac8a-448d-982e-a63ab355c84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=383277b10f8c4cbb8263b24a222a9112, user_id=c6c39af4aae14370a653f0d916af065c, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.914122 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bbf04-8b7b-406a-968b-1235aa837fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:15.914805 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bbf04-8b7b-406a-968b-1235aa837fcc admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:15.915494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bbf04-8b7b-406a-968b-1235aa837fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:15.915494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bbf04-8b7b-406a-968b-1235aa837fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:15.916282 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bbf04-8b7b-406a-968b-1235aa837fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:15.917623 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039148cb-ac8a-448d-982e-a63ab355c84a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.918234 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bbf04-8b7b-406a-968b-1235aa837fcc admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:15.930284 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 596/1186] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:26:15.934312 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bbf04-8b7b-406a-968b-1235aa837fcc admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:15.938469 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 591/1187] 10.222.0.66 () {60 vars in 1483 bytes} [Wed Sep 14 15:26:15 2022] PUT /identity/v3/projects/383277b10f8c4cbb8263b24a222a9112/users/c6c39af4aae14370a653f0d916af065c/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:26:15.944333 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bbf04-8b7b-406a-968b-1235aa837fcc admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:16.003079 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:16.066968 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99bd49-628b-4f1b-9434-be705399ad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:16.068670 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99bd49-628b-4f1b-9434-be705399ad0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:16.068798 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99bd49-628b-4f1b-9434-be705399ad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:16.069206 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99bd49-628b-4f1b-9434-be705399ad0d admin admin] PATH_INFO: `/v3/projects/f6e75120aa234cf7b61d508978eb847e/users/e7bf61a330834d07b506572597dbb4ac/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:16.101799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99bd49-628b-4f1b-9434-be705399ad0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e75120aa234cf7b61d508978eb847e, user_id=e7bf61a330834d07b506572597dbb4ac, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:16.107894 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99bd49-628b-4f1b-9434-be705399ad0d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:16.132667 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 597/1188] 10.222.0.66 () {60 vars in 1483 bytes} [Wed Sep 14 15:26:15 2022] PUT /identity/v3/projects/f6e75120aa234cf7b61d508978eb847e/users/e7bf61a330834d07b506572597dbb4ac/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:26:16.138726 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039148cb-ac8a-448d-982e-a63ab355c84a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:16.146780 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:16.152825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039148cb-ac8a-448d-982e-a63ab355c84a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:16.250421 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e01e1-c2e1-4dbb-8847-749f3c6fafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:16.251895 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e01e1-c2e1-4dbb-8847-749f3c6fafad admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:16.252326 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e01e1-c2e1-4dbb-8847-749f3c6fafad admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:16.252980 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e01e1-c2e1-4dbb-8847-749f3c6fafad admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:16.253958 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e01e1-c2e1-4dbb-8847-749f3c6fafad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:16.255726 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e01e1-c2e1-4dbb-8847-749f3c6fafad admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:16.268934 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 592/1189] 10.222.0.66 () {58 vars in 1122 bytes} [Wed Sep 14 15:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 15:26:16.272980 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99bd49-628b-4f1b-9434-be705399ad0d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:16.285922 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99bd49-628b-4f1b-9434-be705399ad0d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:16.292799 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d6b3a-cf85-4283-b4a0-4cec7d63d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:16.294090 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6b3a-cf85-4283-b4a0-4cec7d63d06e admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:16.294376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6b3a-cf85-4283-b4a0-4cec7d63d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:16.294801 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6b3a-cf85-4283-b4a0-4cec7d63d06e admin admin] PATH_INFO: `/v3/projects/f6e75120aa234cf7b61d508978eb847e/users/e7bf61a330834d07b506572597dbb4ac/roles/6211512533b744e8b1ee9031113654ac` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:16.297780 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d6b3a-cf85-4283-b4a0-4cec7d63d06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e75120aa234cf7b61d508978eb847e, user_id=e7bf61a330834d07b506572597dbb4ac, role_id=6211512533b744e8b1ee9031113654ac)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:16.301361 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d6b3a-cf85-4283-b4a0-4cec7d63d06e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:16.320832 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 598/1190] 10.222.0.66 () {60 vars in 1483 bytes} [Wed Sep 14 15:26:16 2022] PUT /identity/v3/projects/f6e75120aa234cf7b61d508978eb847e/users/e7bf61a330834d07b506572597dbb4ac/roles/6211512533b744e8b1ee9031113654ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:26:21.727240 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246504f3-2a1e-49ef-b69c-a280f040832b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:21.727773 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246504f3-2a1e-49ef-b69c-a280f040832b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:21.727773 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246504f3-2a1e-49ef-b69c-a280f040832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:21.777227 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890f77-48ba-4543-ace7-f5587ed91b1c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:21.777768 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890f77-48ba-4543-ace7-f5587ed91b1c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:21.777863 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890f77-48ba-4543-ace7-f5587ed91b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:21.805218 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-246504f3-2a1e-49ef-b69c-a280f040832b None None] MFA Rules not processed for user `c6c39af4aae14370a653f0d916af065c`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:21.807372 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-246504f3-2a1e-49ef-b69c-a280f040832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:21.843831 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bc890f77-48ba-4543-ace7-f5587ed91b1c None None] MFA Rules not processed for user `e7bf61a330834d07b506572597dbb4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:21.848253 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bc890f77-48ba-4543-ace7-f5587ed91b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:21.913303 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 593/1191] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:21 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:21.926238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246504f3-2a1e-49ef-b69c-a280f040832b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:21.935276 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-246504f3-2a1e-49ef-b69c-a280f040832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:21.974951 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 599/1192] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:21 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:21.986748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890f77-48ba-4543-ace7-f5587ed91b1c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:21.988758 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bc890f77-48ba-4543-ace7-f5587ed91b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:22.087373 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890f77-48ba-4543-ace7-f5587ed91b1c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:22.088156 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246504f3-2a1e-49ef-b69c-a280f040832b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:22.091859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951e6da-4bc9-4078-bbc2-7392ad3ce87d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d18577a8ba44017b686ddf1149e0244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:22.092537 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951e6da-4bc9-4078-bbc2-7392ad3ce87d service glance] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:22.092770 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951e6da-4bc9-4078-bbc2-7392ad3ce87d service glance] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:22.093201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951e6da-4bc9-4078-bbc2-7392ad3ce87d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:22.094446 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e7f44-48a7-44d8-bdea-309bb9908b8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d18577a8ba44017b686ddf1149e0244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:22.095835 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e7f44-48a7-44d8-bdea-309bb9908b8e service glance] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:22.096210 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e7f44-48a7-44d8-bdea-309bb9908b8e service glance] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:22.097891 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e7f44-48a7-44d8-bdea-309bb9908b8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:22.170038 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:22.189959 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:22.221408 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e7f44-48a7-44d8-bdea-309bb9908b8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:22.225188 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e7f44-48a7-44d8-bdea-309bb9908b8e service glance] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:22.237391 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951e6da-4bc9-4078-bbc2-7392ad3ce87d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:22.238986 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951e6da-4bc9-4078-bbc2-7392ad3ce87d service glance] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:22.256184 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 594/1193] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:21 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:26:22.257483 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 600/1194] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:21 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:26:31.230420 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bffa1-2425-4f96-88b3-5cef6b5f0e5b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:31.231133 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bffa1-2425-4f96-88b3-5cef6b5f0e5b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:31.231133 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bffa1-2425-4f96-88b3-5cef6b5f0e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:31.255328 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6b9bffa1-2425-4f96-88b3-5cef6b5f0e5b None None] MFA Rules not processed for user `0b18ca4bf0b34ca68ba6a54963584c50`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:31.256543 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6b9bffa1-2425-4f96-88b3-5cef6b5f0e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:31.264810 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 601/1195] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:26:31 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:31.595386 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260b7b-4e47-4b8d-85d1-a83e3f1de7d3 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:31.596300 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260b7b-4e47-4b8d-85d1-a83e3f1de7d3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:31.596300 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260b7b-4e47-4b8d-85d1-a83e3f1de7d3 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:31.601500 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 595/1196] 10.222.0.66 () {54 vars in 962 bytes} [Wed Sep 14 15:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:26:31.604272 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d08d6-5a94-4a07-8f7f-54ee4865c397 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:31.604547 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d08d6-5a94-4a07-8f7f-54ee4865c397 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:31.604817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d08d6-5a94-4a07-8f7f-54ee4865c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:31.641936 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4b1d08d6-5a94-4a07-8f7f-54ee4865c397 None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:31.643363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4b1d08d6-5a94-4a07-8f7f-54ee4865c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:31.730372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 602/1197] 10.222.0.66 () {58 vars in 1059 bytes} [Wed Sep 14 15:26:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:31.736313 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779ebf-44dd-4b98-81cd-e1cdecde1758 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:31.736661 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779ebf-44dd-4b98-81cd-e1cdecde1758 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:31.737055 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779ebf-44dd-4b98-81cd-e1cdecde1758 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:31.738786 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 596/1198] 10.222.0.66 () {54 vars in 912 bytes} [Wed Sep 14 15:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:26:31.745492 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc221-c0b0-4d79-93f0-751e54f3d354 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:31.746331 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc221-c0b0-4d79-93f0-751e54f3d354 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:31.746769 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc221-c0b0-4d79-93f0-751e54f3d354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:31.775375 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-85ddc221-c0b0-4d79-93f0-751e54f3d354 None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:31.776897 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-85ddc221-c0b0-4d79-93f0-751e54f3d354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:31.787927 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 603/1199] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Sep 14 15:26:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:31.802929 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779ebf-44dd-4b98-81cd-e1cdecde1758 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:31.815480 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779ebf-44dd-4b98-81cd-e1cdecde1758 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:31.819721 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a435af6-a256-4750-a5e1-3b42fb47f297 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d18577a8ba44017b686ddf1149e0244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:31.820712 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a435af6-a256-4750-a5e1-3b42fb47f297 service glance] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:31.821167 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a435af6-a256-4750-a5e1-3b42fb47f297 service glance] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:31.821827 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a435af6-a256-4750-a5e1-3b42fb47f297 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:31.842187 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a435af6-a256-4750-a5e1-3b42fb47f297 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:31.844409 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a435af6-a256-4750-a5e1-3b42fb47f297 service glance] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:31.864486 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 597/1200] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:26:32.234121 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad178-c8b7-4cb6-be65-53a071c0d78d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:32.234654 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad178-c8b7-4cb6-be65-53a071c0d78d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:32.234654 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad178-c8b7-4cb6-be65-53a071c0d78d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:32.235998 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 604/1201] 10.222.0.66 () {54 vars in 912 bytes} [Wed Sep 14 15:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:26:32.244276 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f31c5-9039-4b64-8c78-dfcbef673e8e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:32.244800 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f31c5-9039-4b64-8c78-dfcbef673e8e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:32.245194 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f31c5-9039-4b64-8c78-dfcbef673e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:32.285509 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-050f31c5-9039-4b64-8c78-dfcbef673e8e None None] MFA Rules not processed for user `61155f66cf144f068dabc2000afcccf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:32.286848 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-050f31c5-9039-4b64-8c78-dfcbef673e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:32.376350 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 598/1202] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Sep 14 15:26:32 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:32.389781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad178-c8b7-4cb6-be65-53a071c0d78d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:32.402693 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad178-c8b7-4cb6-be65-53a071c0d78d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:32.407975 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a35d3-6666-49d6-9098-186332819545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:32.408768 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a35d3-6666-49d6-9098-186332819545 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:32.409583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a35d3-6666-49d6-9098-186332819545 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:32.410007 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a35d3-6666-49d6-9098-186332819545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:32.421783 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a35d3-6666-49d6-9098-186332819545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:32.423646 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a35d3-6666-49d6-9098-186332819545 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:32.432295 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 605/1203] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:32 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:26:32.891854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403cbf2-0323-43c6-8963-9feb3e78e896 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:32.892431 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403cbf2-0323-43c6-8963-9feb3e78e896 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:32.892662 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403cbf2-0323-43c6-8963-9feb3e78e896 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:32.895152 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 599/1204] 10.222.0.66 () {54 vars in 962 bytes} [Wed Sep 14 15:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:26:32.903151 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a35d3-6666-49d6-9098-186332819545 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:32.907636 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac169bf-64df-4b23-8259-89f810a7b2ce None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:32.907913 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac169bf-64df-4b23-8259-89f810a7b2ce None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:32.908192 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac169bf-64df-4b23-8259-89f810a7b2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:32.949470 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2ac169bf-64df-4b23-8259-89f810a7b2ce None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:32.951858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2ac169bf-64df-4b23-8259-89f810a7b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:32.962477 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 600/1205] 10.222.0.66 () {58 vars in 1059 bytes} [Wed Sep 14 15:26:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:32.969840 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821186-96e9-4df3-a817-4b3a71abb8d4 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:32.970246 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821186-96e9-4df3-a817-4b3a71abb8d4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:32.970646 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821186-96e9-4df3-a817-4b3a71abb8d4 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:32.972236 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 601/1206] 10.222.0.66 () {54 vars in 912 bytes} [Wed Sep 14 15:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:26:32.979228 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52de3-9758-41fa-bb2d-e9d1f1dbd978 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:32.979648 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52de3-9758-41fa-bb2d-e9d1f1dbd978 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:32.980108 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52de3-9758-41fa-bb2d-e9d1f1dbd978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:32.998809 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a35d3-6666-49d6-9098-186332819545 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:33.006602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-cdb52de3-9758-41fa-bb2d-e9d1f1dbd978 None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:33.007826 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cdb52de3-9758-41fa-bb2d-e9d1f1dbd978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:33.012644 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbddf8d-7feb-4207-bc2e-6f257d41d099 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d0e3301ff94f37a05bfd75397956d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:33.013592 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbddf8d-7feb-4207-bc2e-6f257d41d099 service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:33.014374 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbddf8d-7feb-4207-bc2e-6f257d41d099 service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:33.015204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbddf8d-7feb-4207-bc2e-6f257d41d099 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:33.017755 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2dbddf8d-7feb-4207-bc2e-6f257d41d099 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:33.019641 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 602/1207] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Sep 14 15:26:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:26:33.033105 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb52de3-9758-41fa-bb2d-e9d1f1dbd978 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:33.036784 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbddf8d-7feb-4207-bc2e-6f257d41d099 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:33.038572 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbddf8d-7feb-4207-bc2e-6f257d41d099 service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:33.045939 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb52de3-9758-41fa-bb2d-e9d1f1dbd978 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:33.050682 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:33.051630 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 606/1208] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:26:33.053723 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:33.054288 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:33.054795 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:33.069351 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:33.073974 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:33.094346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 603/1209] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:26:42.490369 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ecd9-8502-4dc9-94b7-cda046b383f1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:42.490930 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ecd9-8502-4dc9-94b7-cda046b383f1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:42.491048 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ecd9-8502-4dc9-94b7-cda046b383f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:42.510992 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-de60ecd9-8502-4dc9-94b7-cda046b383f1 None None] MFA Rules not processed for user `61155f66cf144f068dabc2000afcccf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:42.512224 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-de60ecd9-8502-4dc9-94b7-cda046b383f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:42.518982 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 607/1210] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Sep 14 15:26:42 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:42.531647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:42.533177 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:42.547198 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55499fa3-eddb-4736-b5ae-034bb50825b8 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:42.551209 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4be13-91e3-4247-997d-c48d741dec42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:42.551873 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4be13-91e3-4247-997d-c48d741dec42 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:42.552169 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4be13-91e3-4247-997d-c48d741dec42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:42.552458 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4be13-91e3-4247-997d-c48d741dec42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:42.560955 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4be13-91e3-4247-997d-c48d741dec42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:42.562673 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4be13-91e3-4247-997d-c48d741dec42 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:42.572928 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 604/1211] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:42 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:26:43.487898 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f471e-caae-49ce-9e1b-19ac20c6b356 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:43.488190 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f471e-caae-49ce-9e1b-19ac20c6b356 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:43.488485 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f471e-caae-49ce-9e1b-19ac20c6b356 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:43.490283 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 608/1212] 10.222.0.66 () {54 vars in 921 bytes} [Wed Sep 14 15:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:26:43.501437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b306d7-d7d6-4322-bb0f-d681ce0acd25 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:43.501437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b306d7-d7d6-4322-bb0f-d681ce0acd25 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:43.501437 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b306d7-d7d6-4322-bb0f-d681ce0acd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:43.522902 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e4b306d7-d7d6-4322-bb0f-d681ce0acd25 None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:43.524106 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e4b306d7-d7d6-4322-bb0f-d681ce0acd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:43.536602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 605/1213] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Sep 14 15:26:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:43.576072 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f471e-caae-49ce-9e1b-19ac20c6b356 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:43.592953 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f471e-caae-49ce-9e1b-19ac20c6b356 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:43.598188 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c869-8f1a-467b-bfa2-039a342aa5a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:43.598789 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c869-8f1a-467b-bfa2-039a342aa5a6 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:43.599064 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c869-8f1a-467b-bfa2-039a342aa5a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:43.599354 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c869-8f1a-467b-bfa2-039a342aa5a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:43.609673 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c869-8f1a-467b-bfa2-039a342aa5a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:43.613748 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c869-8f1a-467b-bfa2-039a342aa5a6 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:43.629201 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 609/1214] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:26:49.516148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591532ac-6c5f-41b4-980a-6f872d74814e None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:49.517150 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591532ac-6c5f-41b4-980a-6f872d74814e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:49.517478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591532ac-6c5f-41b4-980a-6f872d74814e None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:49.518838 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 606/1215] 10.222.0.66 () {54 vars in 921 bytes} [Wed Sep 14 15:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:26:49.532795 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64a8d1-9051-482d-b479-aeba77e32779 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:49.533894 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64a8d1-9051-482d-b479-aeba77e32779 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:49.534183 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64a8d1-9051-482d-b479-aeba77e32779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:49.558619 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7d64a8d1-9051-482d-b479-aeba77e32779 None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:26:49.561958 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7d64a8d1-9051-482d-b479-aeba77e32779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:26:49.575024 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 610/1216] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Sep 14 15:26:49 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:26:49.597107 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591532ac-6c5f-41b4-980a-6f872d74814e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:26:49.615479 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591532ac-6c5f-41b4-980a-6f872d74814e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:26:49.621438 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259ac55-1fab-449b-9db9-036c5a699c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:26:49.623066 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259ac55-1fab-449b-9db9-036c5a699c23 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:26:49.623346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259ac55-1fab-449b-9db9-036c5a699c23 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:26:49.623761 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259ac55-1fab-449b-9db9-036c5a699c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:26:49.633793 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259ac55-1fab-449b-9db9-036c5a699c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:26:49.636218 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259ac55-1fab-449b-9db9-036c5a699c23 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:26:49.647428 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 607/1217] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:26:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:26:59.551133 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:26:59.643278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=75 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:02.372754 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64a8d1-9051-482d-b479-aeba77e32779 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:27:02.382330 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64a8d1-9051-482d-b479-aeba77e32779 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:27:02.387029 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e093d-dc48-4bf4-9466-2d6759d2fcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:27:02.387633 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e093d-dc48-4bf4-9466-2d6759d2fcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:02.387912 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e093d-dc48-4bf4-9466-2d6759d2fcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:02.388185 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e093d-dc48-4bf4-9466-2d6759d2fcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:02.397650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e093d-dc48-4bf4-9466-2d6759d2fcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:27:02.399040 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e093d-dc48-4bf4-9466-2d6759d2fcc2 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:27:02.415124 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 611/1218] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:27:02 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:27:04.511762 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dab90-a14a-44e5-a929-5127913811d7 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:04.512354 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dab90-a14a-44e5-a929-5127913811d7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:04.512354 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dab90-a14a-44e5-a929-5127913811d7 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:04.514222 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 608/1219] 10.222.0.66 () {54 vars in 921 bytes} [Wed Sep 14 15:27:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:27:04.519837 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9d353-da2c-4017-a2c8-21032d6ec246 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:04.520363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9d353-da2c-4017-a2c8-21032d6ec246 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:04.520363 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9d353-da2c-4017-a2c8-21032d6ec246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:04.543681 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-57b9d353-da2c-4017-a2c8-21032d6ec246 None None] MFA Rules not processed for user `7eb7034159904b73bcfc7b150843be48`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:27:04.545372 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-57b9d353-da2c-4017-a2c8-21032d6ec246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:27:04.602850 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 612/1220] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Sep 14 15:27:04 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:27:04.616185 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015dab90-a14a-44e5-a929-5127913811d7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:27:04.637825 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015dab90-a14a-44e5-a929-5127913811d7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:27:04.645277 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3c295-68e9-4205-9921-41cd8c5240bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:27:04.645910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3c295-68e9-4205-9921-41cd8c5240bd service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:04.646203 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3c295-68e9-4205-9921-41cd8c5240bd service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:04.646479 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3c295-68e9-4205-9921-41cd8c5240bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:04.658695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3c295-68e9-4205-9921-41cd8c5240bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:27:04.661220 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3c295-68e9-4205-9921-41cd8c5240bd service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:27:04.689417 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 609/1221] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:27:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:27:14.536044 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=9 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:14.669919 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:23.333762 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788660c-84c2-47c1-823a-8d7038532e92 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:23.334309 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788660c-84c2-47c1-823a-8d7038532e92 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:23.334309 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788660c-84c2-47c1-823a-8d7038532e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:23.353494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3788660c-84c2-47c1-823a-8d7038532e92 None None] MFA Rules not processed for user `5cf293fe9a254a189f52f9cf7eeef125`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:27:23.354696 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3788660c-84c2-47c1-823a-8d7038532e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:27:23.361475 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 613/1222] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:27:23 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:27:23.654333 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9444f-9cf7-402d-86f7-ac7e4ecdfcc2 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:23.654858 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9444f-9cf7-402d-86f7-ac7e4ecdfcc2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:23.654955 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9444f-9cf7-402d-86f7-ac7e4ecdfcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:23.674354 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d6f9444f-9cf7-402d-86f7-ac7e4ecdfcc2 None None] MFA Rules not processed for user `61155f66cf144f068dabc2000afcccf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:27:23.675542 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d6f9444f-9cf7-402d-86f7-ac7e4ecdfcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:27:23.682313 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 610/1223] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Sep 14 15:27:23 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:27:23.693241 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788660c-84c2-47c1-823a-8d7038532e92 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:27:23.703092 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788660c-84c2-47c1-823a-8d7038532e92 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:27:23.706614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5f3cf-ebfa-4602-9e24-dae8d3421df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:27:23.707202 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f3cf-ebfa-4602-9e24-dae8d3421df2 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:23.707481 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f3cf-ebfa-4602-9e24-dae8d3421df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:23.707746 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5f3cf-ebfa-4602-9e24-dae8d3421df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:23.714515 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5f3cf-ebfa-4602-9e24-dae8d3421df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:27:23.715927 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5f3cf-ebfa-4602-9e24-dae8d3421df2 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:27:23.723856 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 614/1224] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:27:23 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:27:33.669186 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:33.720580 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=9 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:27:48.695394 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad5ca-dd20-4141-8b9e-18007dfbf903 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:27:48.695845 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad5ca-dd20-4141-8b9e-18007dfbf903 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:27:48.695946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad5ca-dd20-4141-8b9e-18007dfbf903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:27:48.714498 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d7cad5ca-dd20-4141-8b9e-18007dfbf903 None None] MFA Rules not processed for user `5cf293fe9a254a189f52f9cf7eeef125`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:27:48.715687 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d7cad5ca-dd20-4141-8b9e-18007dfbf903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:27:48.722506 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 611/1225] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:27:48 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:27:58.709199 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:28:01.346772 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491a1c-634c-4976-9fdd-bdbcdc76951e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:01.347261 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491a1c-634c-4976-9fdd-bdbcdc76951e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:01.347376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491a1c-634c-4976-9fdd-bdbcdc76951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:01.365684 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-74491a1c-634c-4976-9fdd-bdbcdc76951e None None] MFA Rules not processed for user `5cf293fe9a254a189f52f9cf7eeef125`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:28:01.366879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-74491a1c-634c-4976-9fdd-bdbcdc76951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:28:01.374129 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 615/1226] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:28:01 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:28:11.360814 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:28:58.951523 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e89bf-d861-4d96-bcfe-3bc5e3cf505b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:28:58.952056 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e89bf-d861-4d96-bcfe-3bc5e3cf505b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:28:58.952056 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e89bf-d861-4d96-bcfe-3bc5e3cf505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:28:58.971323 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ac9e89bf-d861-4d96-bcfe-3bc5e3cf505b None None] MFA Rules not processed for user `5cf293fe9a254a189f52f9cf7eeef125`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:28:58.972535 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ac9e89bf-d861-4d96-bcfe-3bc5e3cf505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:28:58.979216 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 612/1227] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:28:58 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:29:08.965910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:29:10.907862 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491a1c-634c-4976-9fdd-bdbcdc76951e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:29:10.926093 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491a1c-634c-4976-9fdd-bdbcdc76951e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:29:10.929594 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dc3a9-7c98-44a0-836c-8a8f442e3afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:29:10.930192 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc3a9-7c98-44a0-836c-8a8f442e3afa service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:29:10.930469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc3a9-7c98-44a0-836c-8a8f442e3afa service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:29:10.930791 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc3a9-7c98-44a0-836c-8a8f442e3afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:29:10.940393 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dc3a9-7c98-44a0-836c-8a8f442e3afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:29:10.941859 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dc3a9-7c98-44a0-836c-8a8f442e3afa service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:29:10.951152 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 616/1228] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:29:10 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:29:20.947018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=10 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:30:32.445120 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e89bf-d861-4d96-bcfe-3bc5e3cf505b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:30:32.468660 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e89bf-d861-4d96-bcfe-3bc5e3cf505b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:30:32.474252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e94a8-51c8-4fcf-aa9b-8b88c44c18a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d0e3301ff94f37a05bfd75397956d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:30:32.474859 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e94a8-51c8-4fcf-aa9b-8b88c44c18a0 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:32.475138 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e94a8-51c8-4fcf-aa9b-8b88c44c18a0 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:32.475413 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e94a8-51c8-4fcf-aa9b-8b88c44c18a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:32.484967 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e94a8-51c8-4fcf-aa9b-8b88c44c18a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:30:32.486609 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e94a8-51c8-4fcf-aa9b-8b88c44c18a0 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:30:32.496886 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 613/1229] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:30:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:30:42.492363 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=10 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:30:49.252504 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6642f-73bb-42bc-a9d1-f93a6b7203fd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:30:49.253036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6642f-73bb-42bc-a9d1-f93a6b7203fd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:30:49.253036 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6642f-73bb-42bc-a9d1-f93a6b7203fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:30:49.271583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-35a6642f-73bb-42bc-a9d1-f93a6b7203fd None None] MFA Rules not processed for user `0b18ca4bf0b34ca68ba6a54963584c50`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:30:49.272769 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-35a6642f-73bb-42bc-a9d1-f93a6b7203fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:30:49.279531 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 617/1230] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:30:49 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:30:59.267298 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:22.291259 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e94a8-51c8-4fcf-aa9b-8b88c44c18a0 service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:22.312355 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e94a8-51c8-4fcf-aa9b-8b88c44c18a0 service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:22.317533 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e1f3-2a0d-47c6-b9a7-2fcbb88c29b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:22.318143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e1f3-2a0d-47c6-b9a7-2fcbb88c29b3 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:22.318427 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e1f3-2a0d-47c6-b9a7-2fcbb88c29b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:22.318705 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e1f3-2a0d-47c6-b9a7-2fcbb88c29b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:22.326679 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e1f3-2a0d-47c6-b9a7-2fcbb88c29b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:22.328271 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e1f3-2a0d-47c6-b9a7-2fcbb88c29b3 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:22.337435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 614/1231] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:22 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:22.379654 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405749f-831f-468e-8836-6fd6a67df476 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:22.380127 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405749f-831f-468e-8836-6fd6a67df476 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:22.380210 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405749f-831f-468e-8836-6fd6a67df476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:22.399578 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8405749f-831f-468e-8836-6fd6a67df476 None None] MFA Rules not processed for user `5cf293fe9a254a189f52f9cf7eeef125`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:31:22.400759 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8405749f-831f-468e-8836-6fd6a67df476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:31:22.407461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 618/1232] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:31:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:31:31.461430 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e1f3-2a0d-47c6-b9a7-2fcbb88c29b3 service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:31.470251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e1f3-2a0d-47c6-b9a7-2fcbb88c29b3 service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:31.474472 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7a5a2-d903-4659-82ab-0cdcab1e2811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:31.475294 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a5a2-d903-4659-82ab-0cdcab1e2811 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:31.475670 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a5a2-d903-4659-82ab-0cdcab1e2811 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:31.476029 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a5a2-d903-4659-82ab-0cdcab1e2811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:31.485756 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7a5a2-d903-4659-82ab-0cdcab1e2811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:31.487160 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7a5a2-d903-4659-82ab-0cdcab1e2811 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:31.497679 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 615/1233] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:32.394707 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:32.684708 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405749f-831f-468e-8836-6fd6a67df476 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:32.694566 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405749f-831f-468e-8836-6fd6a67df476 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:32.698067 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6bc59-194e-49d5-b734-73a68b1b8e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:32.698650 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6bc59-194e-49d5-b734-73a68b1b8e97 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:32.698926 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6bc59-194e-49d5-b734-73a68b1b8e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:32.699193 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6bc59-194e-49d5-b734-73a68b1b8e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:32.709259 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6bc59-194e-49d5-b734-73a68b1b8e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:32.710701 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6bc59-194e-49d5-b734-73a68b1b8e97 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:32.720434 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 619/1234] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:41.168315 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7a5a2-d903-4659-82ab-0cdcab1e2811 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:41.179758 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7a5a2-d903-4659-82ab-0cdcab1e2811 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:41.185251 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83ad8-ff73-4e1a-b4af-3155510128a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:41.185910 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83ad8-ff73-4e1a-b4af-3155510128a8 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:41.186191 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83ad8-ff73-4e1a-b4af-3155510128a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:41.186464 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83ad8-ff73-4e1a-b4af-3155510128a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:41.195109 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83ad8-ff73-4e1a-b4af-3155510128a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:41.196674 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83ad8-ff73-4e1a-b4af-3155510128a8 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:41.205554 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 616/1235] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:41 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:41.476160 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6bc59-194e-49d5-b734-73a68b1b8e97 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:31:41.484519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6bc59-194e-49d5-b734-73a68b1b8e97 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:31:41.488666 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86edf7-9739-463f-8fd6-11a2ec5936f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:31:41.489267 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86edf7-9739-463f-8fd6-11a2ec5936f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:31:41.489583 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86edf7-9739-463f-8fd6-11a2ec5936f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:31:41.489862 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86edf7-9739-463f-8fd6-11a2ec5936f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:31:41.497148 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86edf7-9739-463f-8fd6-11a2ec5936f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:31:41.498602 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86edf7-9739-463f-8fd6-11a2ec5936f5 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:31:41.507154 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 620/1236] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:31:41 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:31:51.201570 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=22 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:31:51.503757 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=12 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:32:37.631263 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83ad8-ff73-4e1a-b4af-3155510128a8 service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:37.647757 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83ad8-ff73-4e1a-b4af-3155510128a8 service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:37.657141 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15ae7b-7f62-49e4-a301-fa4a69876ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:37.659710 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15ae7b-7f62-49e4-a301-fa4a69876ef6 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:37.660206 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15ae7b-7f62-49e4-a301-fa4a69876ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:37.660695 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15ae7b-7f62-49e4-a301-fa4a69876ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:37.673260 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15ae7b-7f62-49e4-a301-fa4a69876ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:37.676261 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15ae7b-7f62-49e4-a301-fa4a69876ef6 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:37.692295 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 617/1237] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:32:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:32:38.796794 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86edf7-9739-463f-8fd6-11a2ec5936f5 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:38.811641 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86edf7-9739-463f-8fd6-11a2ec5936f5 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:38.817111 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed4852-fb8c-4728-ac26-e2aaa05e552a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:38.817919 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed4852-fb8c-4728-ac26-e2aaa05e552a service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:38.818379 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed4852-fb8c-4728-ac26-e2aaa05e552a service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:38.818834 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed4852-fb8c-4728-ac26-e2aaa05e552a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:38.829917 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed4852-fb8c-4728-ac26-e2aaa05e552a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:38.832016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed4852-fb8c-4728-ac26-e2aaa05e552a service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:38.857473 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 621/1238] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:32:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:32:45.379861 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15ae7b-7f62-49e4-a301-fa4a69876ef6 service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:45.388902 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15ae7b-7f62-49e4-a301-fa4a69876ef6 service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:45.392435 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eb1b2-dea3-4756-a694-ed5307ecdc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:45.393278 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eb1b2-dea3-4756-a694-ed5307ecdc88 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:45.393591 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eb1b2-dea3-4756-a694-ed5307ecdc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:45.393865 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eb1b2-dea3-4756-a694-ed5307ecdc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:45.453724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106eb1b2-dea3-4756-a694-ed5307ecdc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:45.455159 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106eb1b2-dea3-4756-a694-ed5307ecdc88 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:45.473286 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 618/1239] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:32:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:32:48.649969 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233de01-356a-4d6e-a4df-8f103ccd7f82 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:48.650502 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233de01-356a-4d6e-a4df-8f103ccd7f82 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:48.650614 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233de01-356a-4d6e-a4df-8f103ccd7f82 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:48.652040 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 622/1240] 10.222.0.66 () {54 vars in 921 bytes} [Wed Sep 14 15:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:32:48.661828 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c6a19-ee9c-4a21-98a9-9ef5329c9151 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:48.662289 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c6a19-ee9c-4a21-98a9-9ef5329c9151 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:48.662380 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c6a19-ee9c-4a21-98a9-9ef5329c9151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:48.743608 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d02c6a19-ee9c-4a21-98a9-9ef5329c9151 None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:32:48.744840 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d02c6a19-ee9c-4a21-98a9-9ef5329c9151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:32:48.753850 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 619/1241] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Sep 14 15:32:48 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:32:48.765053 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233de01-356a-4d6e-a4df-8f103ccd7f82 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:48.781588 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233de01-356a-4d6e-a4df-8f103ccd7f82 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:48.788899 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abb287-4f2d-4e1b-a9e9-78af75f3705e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d0e3301ff94f37a05bfd75397956d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:48.789879 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb287-4f2d-4e1b-a9e9-78af75f3705e service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:48.790599 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb287-4f2d-4e1b-a9e9-78af75f3705e service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:48.791207 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb287-4f2d-4e1b-a9e9-78af75f3705e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:48.804351 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abb287-4f2d-4e1b-a9e9-78af75f3705e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:48.806288 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abb287-4f2d-4e1b-a9e9-78af75f3705e service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:48.818647 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 623/1242] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:32:48 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 15:32:52.198517 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893b22d-d3a0-4b22-a052-16c057618db3 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:52.198983 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893b22d-d3a0-4b22-a052-16c057618db3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:52.199325 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893b22d-d3a0-4b22-a052-16c057618db3 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:52.200676 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 620/1243] 10.222.0.66 () {54 vars in 921 bytes} [Wed Sep 14 15:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:32:52.226776 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b219-344c-4a68-953f-f8af1fe749c4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:52.227263 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b219-344c-4a68-953f-f8af1fe749c4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:52.227366 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b219-344c-4a68-953f-f8af1fe749c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:52.249029 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-55d5b219-344c-4a68-953f-f8af1fe749c4 None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:32:52.250280 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-55d5b219-344c-4a68-953f-f8af1fe749c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:32:52.259413 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 624/1244] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Sep 14 15:32:52 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 15:32:52.275880 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893b22d-d3a0-4b22-a052-16c057618db3 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:52.281527 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5b219-344c-4a68-953f-f8af1fe749c4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:52.297018 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5b219-344c-4a68-953f-f8af1fe749c4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:52.298339 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893b22d-d3a0-4b22-a052-16c057618db3 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:52.302194 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:52.302828 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:52.303104 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:52.303373 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] PATH_INFO: `/v3/users/0b18ca4bf0b34ca68ba6a54963584c50` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:52.304516 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b18ca4bf0b34ca68ba6a54963584c50)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:52.305582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: WARNING py.warnings [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:32:52.305582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: warnings.warn(msg) Sep 14 15:32:52.305582 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: Sep 14 15:32:52.306788 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:52.309095 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818b66f-7ac0-48b7-a83d-396b2883032b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d0e3301ff94f37a05bfd75397956d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:52.309854 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818b66f-7ac0-48b7-a83d-396b2883032b service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:52.310238 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818b66f-7ac0-48b7-a83d-396b2883032b service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:52.310602 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818b66f-7ac0-48b7-a83d-396b2883032b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:52.325235 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818b66f-7ac0-48b7-a83d-396b2883032b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:52.326889 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818b66f-7ac0-48b7-a83d-396b2883032b service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:52.337079 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 621/1245] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:32:52 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:32:52.372319 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b18ca4bf0b34ca68ba6a54963584c50'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.373012 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b18ca4bf0b34ca68ba6a54963584c50'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.380828 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b18ca4bf0b34ca68ba6a54963584c50'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.392381 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b18ca4bf0b34ca68ba6a54963584c50'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.393285 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b18ca4bf0b34ca68ba6a54963584c50'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.416557 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 625/1246] 10.222.0.66 () {58 vars in 1224 bytes} [Wed Sep 14 15:32:52 2022] DELETE /identity/v3/users/0b18ca4bf0b34ca68ba6a54963584c50 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:32:52.599448 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818b66f-7ac0-48b7-a83d-396b2883032b service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:52.610752 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818b66f-7ac0-48b7-a83d-396b2883032b service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:52.666933 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:52.668041 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:52.668374 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:52.668572 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] PATH_INFO: `/v3/projects/eab144fde5684204b6c33461618a76d2` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:52.669714 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab144fde5684204b6c33461618a76d2)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:52.670714 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: WARNING py.warnings [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 15:32:52.670714 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: warnings.warn(msg) Sep 14 15:32:52.670714 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: Sep 14 15:32:52.671893 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:52.696128 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:32:52.731796 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab144fde5684204b6c33461618a76d2', 'request_id': 'req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.738052 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab144fde5684204b6c33461618a76d2', 'request_id': 'req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.746462 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab144fde5684204b6c33461618a76d2', 'request_id': 'req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.766735 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] The token cache is being invalidate because project eab144fde5684204b6c33461618a76d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:32:52.767025 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.767704 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.769486 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 622/1247] 10.222.0.66 () {58 vars in 1233 bytes} [Wed Sep 14 15:32:52 2022] DELETE /identity/v3/projects/eab144fde5684204b6c33461618a76d2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:32:52.773590 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:52.775038 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:32:52.789812 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b575b-8ff3-46f9-bbca-e5367188037c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:52.847016 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:52.847656 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:52.847941 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:52.848218 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] PATH_INFO: `/v3/users/c6c39af4aae14370a653f0d916af065c` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:52.849357 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c39af4aae14370a653f0d916af065c)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:52.851297 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:52.893461 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:32:52.899303 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c39af4aae14370a653f0d916af065c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.900404 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c39af4aae14370a653f0d916af065c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.908469 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c39af4aae14370a653f0d916af065c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.915203 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c39af4aae14370a653f0d916af065c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.915817 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5199fa63-19ac-4c17-b8eb-b1046a1a6008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c39af4aae14370a653f0d916af065c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:52.933057 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 626/1248] 10.222.0.66 () {58 vars in 1224 bytes} [Wed Sep 14 15:32:52 2022] DELETE /identity/v3/users/c6c39af4aae14370a653f0d916af065c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 15:32:53.107143 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:32:53.108697 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:32:53.121946 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7db2-a9dd-49e3-a4ee-8bf812a5ee6b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:32:53.182398 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:32:53.183658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:32:53.183877 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:32:53.184148 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] PATH_INFO: `/v3/projects/383277b10f8c4cbb8263b24a222a9112` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:32:53.185284 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383277b10f8c4cbb8263b24a222a9112)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:32:53.187252 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:32:53.232017 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383277b10f8c4cbb8263b24a222a9112', 'request_id': 'req-36a0c385-2237-446b-b004-fa243f6b7819'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:53.237429 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383277b10f8c4cbb8263b24a222a9112', 'request_id': 'req-36a0c385-2237-446b-b004-fa243f6b7819'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:53.244713 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383277b10f8c4cbb8263b24a222a9112', 'request_id': 'req-36a0c385-2237-446b-b004-fa243f6b7819'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:53.255907 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] The token cache is being invalidate because project 383277b10f8c4cbb8263b24a222a9112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:32:53.256222 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:53.256846 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:32:53.258346 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 623/1249] 10.222.0.66 () {58 vars in 1233 bytes} [Wed Sep 14 15:32:53 2022] DELETE /identity/v3/projects/383277b10f8c4cbb8263b24a222a9112 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:33:02.929636 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:33:03.253068 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:33:27.860806 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e61743-9a66-40a8-827b-1120dd8aa35b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:27.861347 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e61743-9a66-40a8-827b-1120dd8aa35b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:27.861435 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e61743-9a66-40a8-827b-1120dd8aa35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:27.881153 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-50e61743-9a66-40a8-827b-1120dd8aa35b None None] MFA Rules not processed for user `5cf293fe9a254a189f52f9cf7eeef125`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:33:27.882376 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-50e61743-9a66-40a8-827b-1120dd8aa35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:27.937060 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 627/1250] 10.222.0.66 () {58 vars in 958 bytes} [Wed Sep 14 15:33:27 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:33:28.258168 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:28.259561 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:28.319174 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0c385-2237-446b-b004-fa243f6b7819 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:28.323338 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:28.324658 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:28.324940 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:28.325217 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:28.330176 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:28.339777 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:28.341200 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:28.348856 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 624/1251] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:33:28 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:33:28.785112 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e61743-9a66-40a8-827b-1120dd8aa35b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:28.786621 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-50e61743-9a66-40a8-827b-1120dd8aa35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:28.860845 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e61743-9a66-40a8-827b-1120dd8aa35b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:28.865845 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55421-d22d-47ec-b08e-036783b3fe0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d0e3301ff94f37a05bfd75397956d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:28.866447 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55421-d22d-47ec-b08e-036783b3fe0e service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:28.866723 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55421-d22d-47ec-b08e-036783b3fe0e service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:28.867019 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55421-d22d-47ec-b08e-036783b3fe0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:28.868705 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ece55421-d22d-47ec-b08e-036783b3fe0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:28.880046 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece55421-d22d-47ec-b08e-036783b3fe0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:28.881636 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece55421-d22d-47ec-b08e-036783b3fe0e service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:28.891969 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 628/1252] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:33:28 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:33:37.598473 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:33:37.599917 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:37.670806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2153bf-33ba-4151-846a-6d28f90cdcaa service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:33:37.675762 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b2078-7352-405c-bff7-47a883c1c477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb7034159904b73bcfc7b150843be48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:33:37.676367 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b2078-7352-405c-bff7-47a883c1c477 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:33:37.676647 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b2078-7352-405c-bff7-47a883c1c477 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:33:37.676922 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b2078-7352-405c-bff7-47a883c1c477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:33:37.678656 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-670b2078-7352-405c-bff7-47a883c1c477 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:33:37.690200 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b2078-7352-405c-bff7-47a883c1c477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:33:37.691766 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b2078-7352-405c-bff7-47a883c1c477 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:33:37.701694 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 625/1253] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:33:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:33:38.887869 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=57 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:33:47.697287 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=58 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:35:39.455622 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2b55d-60f2-4d47-bf2b-0e62fe6bb0fa None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:35:39.456086 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2b55d-60f2-4d47-bf2b-0e62fe6bb0fa None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:35:39.456185 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2b55d-60f2-4d47-bf2b-0e62fe6bb0fa None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:35:39.457522 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 629/1254] 10.222.0.66 () {54 vars in 961 bytes} [Wed Sep 14 15:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 15:35:39.463021 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bacbc0-1737-4874-8210-61c654965992 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:35:39.463455 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bacbc0-1737-4874-8210-61c654965992 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:35:39.463586 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bacbc0-1737-4874-8210-61c654965992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:35:39.502047 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-97bacbc0-1737-4874-8210-61c654965992 None None] MFA Rules not processed for user `55d0e3301ff94f37a05bfd75397956d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 15:35:39.503285 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-97bacbc0-1737-4874-8210-61c654965992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:35:39.553393 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 626/1255] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Sep 14 15:35:39 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 15:35:39.560943 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2b55d-60f2-4d47-bf2b-0e62fe6bb0fa None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:35:39.574646 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2b55d-60f2-4d47-bf2b-0e62fe6bb0fa None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:35:39.579609 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d0e3301ff94f37a05bfd75397956d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:35:39.580202 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:35:39.580485 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:35:39.580764 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:35:39.582494 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:35:39.594163 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:35:39.595735 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:35:39.605367 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 630/1256] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:35:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:35:49.551293 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=29 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:35:49.601250 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=6 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:36:05.867091 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bacbc0-1737-4874-8210-61c654965992 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:36:05.878307 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bacbc0-1737-4874-8210-61c654965992 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:36:05.881830 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61155f66cf144f068dabc2000afcccf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be6d4eeb19e4b57b595d5bcb139e9fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:36:05.882425 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:36:05.882700 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:36:05.882973 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:36:05.885129 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:36:05.987623 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:36:05.989063 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:36:05.999243 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 627/1257] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Sep 14 15:36:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 15:36:12.316781 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:36:12.319519 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:36:12.333529 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f7838-2dab-484f-8cbc-54efa13cad85 service placement] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:36:12.339178 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:36:12.340060 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:36:12.340338 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:36:12.340611 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] PATH_INFO: `/v3/users/5cf293fe9a254a189f52f9cf7eeef125` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:36:12.356098 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf293fe9a254a189f52f9cf7eeef125)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:36:12.358125 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:36:12.407706 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf293fe9a254a189f52f9cf7eeef125'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.408656 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf293fe9a254a189f52f9cf7eeef125'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.417436 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf293fe9a254a189f52f9cf7eeef125'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.425166 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf293fe9a254a189f52f9cf7eeef125'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.426204 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf293fe9a254a189f52f9cf7eeef125'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.448260 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 631/1258] 10.222.0.66 () {58 vars in 1224 bytes} [Wed Sep 14 15:36:12 2022] DELETE /identity/v3/users/5cf293fe9a254a189f52f9cf7eeef125 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:36:12.629097 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:36:12.639904 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4ae46-1dcd-46cc-b5b4-b76cc5ee5938 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:36:12.703671 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:36:12.704307 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:36:12.704592 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:36:12.704870 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] PATH_INFO: `/v3/projects/4bf4b080069347b4b560ff59edcfd87e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:36:12.716016 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf4b080069347b4b560ff59edcfd87e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:36:12.717980 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:36:12.764124 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf4b080069347b4b560ff59edcfd87e', 'request_id': 'req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.771620 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf4b080069347b4b560ff59edcfd87e', 'request_id': 'req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.779769 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf4b080069347b4b560ff59edcfd87e', 'request_id': 'req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.785968 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:36:12.798438 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] The token cache is being invalidate because project 4bf4b080069347b4b560ff59edcfd87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:36:12.798987 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.800004 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.801954 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 628/1259] 10.222.0.66 () {58 vars in 1233 bytes} [Wed Sep 14 15:36:12 2022] DELETE /identity/v3/projects/4bf4b080069347b4b560ff59edcfd87e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:36:12.806017 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:36:12.807508 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:36:12.821594 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2ace6-9ace-403f-935c-6d7cbd4fe550 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:36:12.880323 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:36:12.881734 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:36:12.882037 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:36:12.882672 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] PATH_INFO: `/v3/users/e7bf61a330834d07b506572597dbb4ac` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:36:12.885743 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bf61a330834d07b506572597dbb4ac)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:36:12.886779 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:36:12.933740 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bf61a330834d07b506572597dbb4ac'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.934382 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bf61a330834d07b506572597dbb4ac'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.941672 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bf61a330834d07b506572597dbb4ac'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.949292 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bf61a330834d07b506572597dbb4ac'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.949956 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-107127b4-c9e0-4e66-850d-be810726fa0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bf61a330834d07b506572597dbb4ac'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:12.951188 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:36:12.970942 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 632/1260] 10.222.0.66 () {58 vars in 1224 bytes} [Wed Sep 14 15:36:12 2022] DELETE /identity/v3/users/e7bf61a330834d07b506572597dbb4ac => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:36:13.143494 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 15:36:13.145175 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 15:36:13.159527 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8b31d-07b4-4634-8cf8-fdd283baaf5d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 15:36:13.216806 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076e0863cb5c4974ba2d2e1b515b38f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd960b8bb994249d4bc3ba704789927ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 15:36:13.217478 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 15:36:13.217765 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 15:36:13.218045 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] PATH_INFO: `/v3/projects/f6e75120aa234cf7b61d508978eb847e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 15:36:13.219169 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e75120aa234cf7b61d508978eb847e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 15:36:13.221074 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 15:36:13.280779 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e75120aa234cf7b61d508978eb847e', 'request_id': 'req-cefc3be7-8157-4307-aee6-2d0b7c920312'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:13.286583 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e75120aa234cf7b61d508978eb847e', 'request_id': 'req-cefc3be7-8157-4307-aee6-2d0b7c920312'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:13.296316 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e75120aa234cf7b61d508978eb847e', 'request_id': 'req-cefc3be7-8157-4307-aee6-2d0b7c920312'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:13.310438 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] The token cache is being invalidate because project f6e75120aa234cf7b61d508978eb847e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 15:36:13.310724 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:13.311368 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cefc3be7-8157-4307-aee6-2d0b7c920312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 15:36:13.313265 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 629/1261] 10.222.0.66 () {58 vars in 1233 bytes} [Wed Sep 14 15:36:13 2022] DELETE /identity/v3/projects/f6e75120aa234cf7b61d508978eb847e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 15:36:22.967398 dv-osbrick-853789-4-ceph devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 15:36:23.307369 dv-osbrick-853789-4-ceph devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}